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SUMMARY 

Background 

Efficient  and  effective  selection  of  recruiters  is  one  of  the  most 
challenging  tasks  confronting  the  military  services  in  the  All  Recruited  Force 
era.  As  a  declining  youth  population  decreases  the  pool  of  potential  recruits, 
recruiting  is  expected  to  become  more  difficult.  Appropriate  recruiter  selection 
procedures  can  increase  the  likelihood  that  authorized  strength  levels  will  be 
met  in  a  cost-effective  manner. 

The  US  Army  Recruiting  Command  (USARBC)  became  responsible  for  recruiting 
for  the  US  Army  Reserve  (USAR)  in  1979  and  in  1986  had  nearly  1,800  Reserve 
recruiters.  Unlike  its  Active  Army  counterpart,  the  USAR  is  a  geographically 
limited  entity  and  must  structure  its  recruiting  efforts  in  local  markets  to  meet 
the  diverse  personnel  requirements  of  a  large  number  of  geographically  dispersed 
Reserve  units. 

Past  research  indicates  that  two  categories  of  factors  have  been  identified 
for  their  utility  in  predicting  successful  recruiter  performance.  One  category 
includes  biographical  and  personal  history  characteristics  which  are  available  in 
standard  military  personnel  files  while  the  second  group  of  factors  is  comprised 
of  measures  of  behavioral  and  personality  traits.  Neither  set  of  measures  have 
proved  satisfactory  in  predicting  recruiter  success. 

Purpose 

The  purpose  of  this  study  is  to  evaluate  existing  literature  and  data  on 
recruiter  performance  and  characteristics,  to  identify  attributes  associated  with 
suc  cessful  recruiters,  and  to  develop  a  model  to  aid  in  the;  selec.-t  ion  of 
personnel  who  are  most  likely  to  become  successful  recruiters. 


Traditional  methods  for  identifying  the  personnel  characteristics  which  are 


associated  with  recruiter  success  rely  on  the  existence  of  reliable  and  valid 


measures  of  both  the  relevant  personal  attributes  and  of  recruiter  performance. 
Previous  studies  of  recruiter  productivity  have  suffered  from  an  inability  to 
control  for  differences  in  local  market  factors.  The  "criterion"  problem,  or  the 
lack  of  a  yardstick  that  objectively  measures  recruiter  productivity  has 
prohibited  successful  application  of  conventional  multivariate  statistit;al 
techniques  to  the  problem  of  identifying  the  relative  importance  of  factors 
affecting  recruiter  success. 

Method 


This  study  applies  a  relatively  new  methodology,  expert  systems,  to  the 
recruiter  selection  problem.  This  technology,  a  branch  of  artificial 
intelligence,  has  proved  particularly  useful  in  dealing  with  problems  involving 
subjective  Judgment.  Recruiter  selection  presents  Just  such  a  decision  problem. 
An  appropriate  expert  systems  shell  can  be  used  to  develop  a  multiattribute 
utility  model  for  evaluating  recruiter  candidates. 


y:*- 

The  ex 

analys is ; 

attributes. 

success . 

A.  • 

• 

Expert 

recruiters 

models  were  constructed  for  Reserve  and  Active  recruiters.  The  validity  of  these 
.systems  was  evaluated  by  the  expert  systems  program  itself.  All  of  the  systems 
fleve-loped  for  recruiters  showed  high  marks  for  all  of  the  intirriiul  tests  of 
validity.  Twenty  hypothetical  recruiter  applicants  were  then  screened  by  eacli  of 
the  expert  systems  and  a  fairly  consistent  pattern  of  selection  and  rejection 
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Results 


The  characteristics  of  a  successful  recruiter  may  be  inferred  from  the 
weights  assigned  to  individual  attributes  within  the  dimensions  identified  by  the 
expert  systems.  Recruiter  attributes  were  grouped  into  six  dimensions; 
Communication  Skills,  Personality  Characteristics,  Behavior  characteristics, 
Military  background.  Demographic  Characteristics,  and  Specific  Experience.  This 
hierarchy  of  attributes  is  based  on  the  findings  of  previous  studies  and  also 
upon  the  opinions  of  experts  in  the  recruiting  field.  It  includes  both  the 
biodemographic  factors  and  the  personality/behavior  traits  identified  by  earlier 
researchers. 

On  the  whole,  Reserve  recruiters  judged  Communication  Skills,  Demographic 
Characteristics,  and  Personality  Characteristics  to  be  the  most  important 
dimensions  for  successful  recruiting,  while  Active  recruiters  felt  that 
Commiuiication  Skills,  Personality  Characteristics,  and  Behavior  Characteristics 
were  most  important. 

Reserve  recruiter-experts  saw  a  potentially  successful  candidate  as  an 
individual  who  is  intelligent,  persuasive,  self-motivated,  high-ranking  for  his 
or  her  length-of-service,  and  who  has  some  sales  experience.  Active  recruiters 
have  a  similar  ideal  cemdidate  who  possesses  public  speaking  experience  rather 
than  sales  experience  and  has  many  years  of  service  (Active  Duty)  rather  than 
high  rank,  but  with  otherwise  identical  characteristics.  A  major  benefit  of  an 
expert  systems  approach  is  that  the  derived  models  give  a  role  to  every  attribute 
within  an  extensive  hierarchy  of  attributes  and  develop  an  internally  consistent 
selection  tool  reflecting  all  of  the  characteristics. 


Recoiiunenuat  ions 

The  application  of  expert  systems  technology  to  problems  of  personnel 
selection  is  in  the  very  early  stages  of  development.  The  artificial 
intelligence  field  itself  Is  rapidly  advancing  and  promises  to  provide  solutions 
to  many  difficult  questions.  Currently,  however,  there  are  severe  limitations  to 
the  usefulness  of  these  methods  in  solving  so  complex  a  problem  as  recruiter 
selection.  The  model  developed  here  does  succeed,  to  a  great  extent,  in 
assigning  weights  to  personal  attributes  in  an  objective  manner  within  the 
context  of  an  un.«=r'o.-if ied  criterion  for  recruiter  success.  It  does  not,  however, 
simulate  the  intricate  px ocesses  of  human  reasoning  which  are  involved  in  the 
selection  of  essential  personnel  by  a  large  organization. 

There  are  several  important  areas  for  future  work.  One  is  the  construction 
of  expert  systems  shells  which  better  suit  the  specific  decision  problem  and  a 
tailoring  of  the  knowledge  acquisition  aspect  of  the  programs  to  suit  the 
recruiter  experts.  A  second  area  for  further  work  is  the  measurement  of 
personality  and  behavior  traits  for  recruiter  candidates  so  that  these  values  can 
be  used  in  testing  expert  systems  models.  A  third  task  is  the  continuation  of 
research  into  the  c:haracterist ics  associated  with  recruiter  success.  The 
hierarchies  which  provide  the  basic  structure  for  the  expert  systems  model  must 
come  from  knowledge  of  the  dynamics  of  the  recruiting  process. 
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1.  INTRODUCTION 

A .  Purpose 

Recruiter  selection  is  one  of  the  most  challengintJ  tasks  confront inK  the 
military  services  in  the  All  Volunteer  Force  era.  Recruiting  is  expected  to 
become  more  difficult  as  a  declining  youth  population  decreases  the  pool  ol' 
potential  recruits.  The  services  not  only  compete  with  each  other  but  will 
continue  to  compete  with  the  civilian  sector  for  qualified  personnel  in  a 
declining  manpower  pool.  Additionally,  budget  constraints  may  severely  limit  the 
resouices  available  to  attract  the  necessary  quantity  and  quality  ol  new 
enlistees.  As  a  result,  the  services  will  increasingly  need  to  maximize  the 
efficient  selection  and  utilization  of  their  recruiter  manpower.  Effective 
selection  procedures  increase  the  likelihood  that  enough  people  will  be  recruited 
to  meet  authorized  strength  levels,  recruiting  goals,  and  assigned  missions. 

The  costs  of  inappropriate  recruiter  selection  methods  are  considerable  in 
terms  of  both  monetary  and  human  resources.  Poor  recruiter/ job  matches  decrease 
productivity  and  increase  turnover  and  related  costs  resulting  from  moving, 
training,  and  replacing  recruiters  who  are  not  right  for  the  job.  Individuals 
are  usually  selected  for  recruiting  duty  from  among  those  with  high  performance 
ratings  in  previous  assignments  and  if  these  junior  noncommissioned  ofi’icers  arc 
not  successful  on  recruiting  duty,  their  self-confidence,  attitude,  and 
motivation  are  likely  to  suffer  and  may  lead  to  poor  performance  in  future 
assignments  or  early  attrition. 

The  purpose  of  this  study  is  to  identify  attributes  associated  with 
successful  recruiters,  to  evaluate  existing  data  on  recruiter  performance  and 
characteristics,  and  to  develop  a  model  to  aid  in  the  selection  of  personnel  who 
are  most  likely  to  become  successful  recruiters. 


Chapter  II  discusses  previous  studies  which  have  attempted  to  identity 
successful  recruiters  and  points  out  the  serious  deficiencies  in  data, 
particularly  performance  measures,  which  have  inhibited  the  development  of  useful 
recruiter  selection  procedures.  Chapter  III  introduces  a  methodology  bused  on 
expert  systems  technology  which  is  used  to  overcome  meiny  of  the  problems 
encountered  in  previous  attempts  to  establish  criteria  for  recruiter  selection 
using  more  traditional  methods.  Chapter  IV  describes  the  characteristics  of  the 
expert  systems  developed  for  Army  Active  and  Reserve  recruiters  and,  from 
interviews  with  16  recruiting  "experts",  investigates  methods  for  deriving 
composite  models,  evaluates  the  expert  systems,  and  discusses  in  detail  the 
dimensions  and  attributes  embodied  in  the  models.  Chapter  V  presents  conclusions 
based  on  the  literature  and  data  review  and  on  the  prototype  expert  sysLcm 
application  as  well  as  recommendations  for  future  work. 

B .  Background 

The  group  of  Reserve  recruiters  investigated  in  the  empirical  portions  of 
this  report  represent  particularly  difficult  selection,  assignment,  and  training 
problems  for  the  Army  Recruiting  Command  (USAREC).  USAREC  first,  became 
responsible  for  recruiting  for  the  US  Army  Reserve  (USAR)  in  1979  and  now  has 
nearly  1,800  people  serving  as  reserve  recruiters.  Unlike  its  Activa;  Armiy 
counterpart,  the  USAR  is  a  geographically  limited  entity  and  must  structure  its 
recruiting  efforts  in  local  markets  to  meet  the  diverse  personnel  requirements  of 
a  large  number  of  geographically  dispersed  Reserve  units. 

USAR  recruiters  comprise  a  volunteer  force  crhosen  by  USAREC  Horn  a  field  ot' 
solicited,  qualified  USAR  applicants.  Currently,  the  selection  criteria  for  USAR 
r<;cruiLt:rs  are  based  upon  administrative  regulations  and  personal  interviews  or 
references  at  the  recruiting  battalion  level.  USAREC  has  56  recruiting 


battalions  and  other  commands  within  its  organization.  Each  battalion  commander 


is  responsible  for  soliciting  applications  and  conducting  interviews  to  fill  USAR 


vacancies,  most  of  which  are  recruiter  positions.  [Ref.  2]  The  battalion 


commander  selects  or  rejects  an  applicant  and  sends  the  application  to  USAREC  for 


administrative  review.  If  USAREC’s  review  is  favorable  the  application  is 


forwarded  to  the  Army  Reserve  Personnel  Center  (APPERCEN)  where  a  final  decision 


is  made.  [Ref.  1;  p.  25] 


The  interview  phase  is  a  very  important  part  of  the  recruiter  selection 


process  and  each  recruiting  battalion  has  the  authority  to  conduct  interviews 


based  on  its  own  rules  and  needs.  The  number  of  board  members  and  their 


composition  can  vary  widely.  There  are  few  guidelines  to  help  board  members  and 


battalion  commanders  in  making  critical  selection  decisions.  A  better  under 


standing  of  the  relationship  of  personal  characteristics  and  successful  perfor¬ 


mance  as  a  recruiter  would  make  these  decisions  easier.  In  addition,  a  model  for 


establishing  objective  criteria  for  recruiter  selection  could  provide  a  useful 


structure  for  the  decision  making  process. 


■r.  -v 


II.  LITERATURE  AND  DATA  REVIEW 


A .  Forward 


All  of  the  military  services  have  studied  ways  to  select  personnel  that  have 


the  highest  likelihood  of  becoming  successful  recruiters.  This  literature  review 


provides  an  overview  of  research  on  the  selection  of  successful  recruiters.  The 


review  includes  discussions  of  methodologies  for  determining  factors  associated 


with  successful  recruiting,  consistency  and  validity  of  results,  commonality  of 


resultant  factors,  limitations  and  problems  encountered,  and  concludes  with  an 


assessment  of  future  research  needs  in  this  area. 


While  all  branches  of  the  military  are  represented  in  the  literature,  Air 


Force  studies  are  outnumbered  by  a  wide  margin.  There  appear  to  be  at  least  two 


reasons.  For  the  first  few  years  after  the  inception  of  the  All  Recruited  Force, 


the  services  fielded  volunteer  recruiter  forces.  Today,  however,  all  active 


services  except  the  Air  Force  rely  on  recruiting  forces  comprising  mainly  non¬ 


volunteers.  Another  explanation  for  the  Air  Force’s  comparatively  small  body  of 


research  on  recruiter  selection  is  that  service’s  historic  recruiting  success. 


The  Air  Force  has  been  the  number  one  branch  choice  among  potential  enlistees  for 


decades,  and  the  service  has  met  its  recruiting  goals  with  no  apparent 


difficulty.  Thus,  the  Air  Force  may  not  have  had  as  much  need  to  examine  the 


recruiter  selection  issue. 


Various  methods  have  been  used  to  conduct  research  in  recruiter  selection. 


Most  researchers  used  paper-and-pencil  test  batteries  in  their  attempts  to 


identify  characteristics  of  successful  recruiters  and  predict  recruiter  perlor- 


raance.  Other  researchers  used  biographical  information,  structured  and  un¬ 


structured  interviews,  job  analysis,  assessment  centers,  and  other  methods. 


In  general,  the  results  of  previous  studies  have  been  disappointing. 


In 


many  studies,  few  results  were  statistically  sign! 1  leant .  In  others,  results 
that  were  significant  had  dubious  meaning  and  were  not  cross-validated.  In  still 
others  when  cross-validation  was  attempted,  original  results  could  not  be* 
dup 1 icated. 

Several  common  problems  in  previous  research  help  to  explain  their  disap¬ 
pointing  results.  The  most  common  difficulty  was  the  "criterion  problem": 
measuring  recruiter  performance  in  a  reliable  and  valid  manner.  [Ref.  3;  p.  IBj 
Prior  studies  have  used  a  variety  of  measures  to  attempt  to  capture  recruiter 
performance:  supervisory  ratings,  school  performance,  percent  of  quota  achieved, 
and  total  number  of  recruits  enlisted  have  been  used  as  performance  measures, 
amoni;  otiiers.  Supervisory  ratings  are  often  unreliable  and  of  questionable 
validity.  Even  with  the  best  of  intentions,  supervisors  can  be  influenced  by 
characteristics  unrelated  to  job  effectiveness  ([Ref.  4;  p.  Ij).  This  can  lead 
to  evaluations  based  on  reputation  rather  than  performance.  Recruiting  school 
performance  has  limitations  as  a  measure  of  recruiting  performance  since 
graduates  of  recruiting  school  may  perform  differently  in  the  field  than  they  do 
in  training.  [Ref.  5;  pp.  14-16] 

The  greatest  limitation  in  analyzing  characteristics  of  successful 
recruiters  is  the  inability  of  recruiter  production  concepts — such  as  percent  of 
quota  achieved  and  total  number  of  recruits  enlisted--to  provide  a 
straightforward  measure  of  success  of  an  individual  recruiter.  Recruiter 
production  figures  that  do  not  account  for  market  effects  or  "opportunity  bias” 
(the  relative  ease  or  difficulty  in  obtaining  enlistments  in  a  particular  market) 
cannot  provide  a  basis  for  examining  variations  in  productivity  due  to 
differences  in  individual  recruiters.  A  recruiter’s  successful  production  might 
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be  the  result  of  having  been  assigned  to  a  fertile  recruiting  territory.  The 


studies  using  recruiter  performance  as  a  criterion  measure  and  personnel 
characteristics  as  explanatory  factors  have  universally  been  inadequate  in  their 
incorporation  of  market  factors  for  explaining  variation  in  reciuiter 
performance.  Such  omitted  variable  approaches  yield  results  that  inaccurately 
associate  variation  in  recruiter  performance  to  variation  in  personnel 
characteristics.  Limited  information  about  the  recruiter’s  job  reduced  the 
usefulness  of  some  of  the  earlier  research.  Later  studies  benefitted  from 
information  collected  through  job  analysis  [Ref.  7]. 

Appropriate  consideration  of  the  selection  environment  is  a  necessary 
consideration  in  recruiter  selection.  The  number  of  recruiter!  selected  in¬ 
voluntarily  varies  by  bramch  of  service.  The  Air  Force  is  currently  the  only 
service  whose  active  duty  recruiters  are  all  volunteers.  Selection  procedures 
also  vary  within  a  service.  For  example,  nearly  all  of  the  Army’s  Active  Guard 
and  Reserve  (AGR)  recruiters  are  volunteers,  yet  most  recruiters  who  enlist 
people  into  the  Regular  Army  are  non-volunteers.  Since  most  active  duty 
recruiters  are  now  selected  involuntarily,  recent  research  has  attempted  to 
identify  reliable  recruiter  selection  methods  that  would  not  be  vulnerable  to 
compromise  or  "faking,"  as  are  test  batteries.  These  problems  with  test 
batteries  have  amplified  interest  in  passive  methods  using  demographic, 
biographical,  and  military  experience  data  the  services  maintain  routinely  in 
various  data  banks.  Unfortunately,  the  inability  to  determine  adequately  the 
relative  importance  of  background  and  personality  factors  has  severely  limited 
the  payoff  from  the  use  of  such  passive  methods. 

This  section  discusses  relevant  studies  attempting  to  identify  character 
istics  of  successful  recruiters.  The  studies  are  organized  by  the  sourct-  of 
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information  used  to  identify  successful  recruiters:  interviews,  test  batteries, 
assessment  centers,  and  personnel  file  data.  Unless  particularly  relevant,  older 
studies  are  discussed  fairly  briefly.  More  recent  work  is  discussed  in  greater 
detail . 

B.  Interviews 

1.  Borman,  Hough,  and  Ounnette 

In  1976,  Borman,  Hough,  and  Dunnette,  at  the  Naval  Personnel  Research 
and  Development  Center  (NPRDC)  attempted  to  develop  behavioral ly-based  rating 
scales  to  evaluate  the  performance  of  Navy  recruiters  [Ref.  6].  They  believed 
that  an  extensive  analysis  of  the  recruiter  job  would  be  required  before  any 
further  research  on  recruiter  selection  could  be  accompl ished.  To  become 
familiar  with  the  recruiter  job,  recruiters,  supervisors,  and  recruits  were 
interviewed.  During  two  days  of  workshops,  more  than  800  critical  incidents 
(examples  of  recruiter  performance)  describing  effective  and  ineffective 
recruiting  performance  were  obtained  from  field  recruiters  from  all  Navy 
Recruiting  Areas.  Another  135  performance  examples  were  solicited  from  Navy 


recruits  during  interviews  at  boot  camp.  NPRDC’s  1976  study  was  the  springboard 
for  three  additional  studies  conducted  over  the  past  ten  years.  These  studies 
are  discussed  in  the  section  on  test  butteries. 

2.  Borman,  Toquam  and  Posse 

Borman,  Toquam  and  Posse’s  1977  Army  Research  Institute  study  echoed 
the  1976  NPRDC  study,  hypothesizing  that  a  reason  why  paper-and  pencil  predictors 
of  Army  recruiter  effectiveness  hud  met  with  such  little  success  was  that  not 
enough  was  known  about  the  performance  requirements  of  the  recruiter  job  |Ref. 
7).  This  study  focused  on  dist.overing  these  performance  requirements  by 
attempting  to  define  the  underlying  task  dimensions  associated  with  Army 


recruiter  and  guidance  counselor  jobs. 


The  first  step  was  to  revise  an  existing  Department  of  the  Army  task 
list  that  described  Military  Occupational  Specialty  (MOS)  designator  OOE.  Army 
recruiters  and  guidance  counselors  share  this  MOS  because  their  jobs  are  similar. 
The  recruiter’s  job  is  to  qualify  prospective  applicants.  The  guidance 
counselor’s  tusk  is  to  convince  them  to  accept  a  particular  entry  level 
assignment.  After  a  pilot  test,  the  revised  task  inventory  was  administered  to 
101  field  recruiters,  guidance  (counselors,  and  supervisors  across  all  live 
recruiting  regions.  These  e.xperts  sorted  the  tasks  into  groups,  or  dimensions, 
according  to  the  tasks’  perceived  similarity  with  respect  lo  job  function. 
Participants  worked  on  their  own,  each  sorting  task  statements  into  categories. 

flel'orc  analyiiing  the  data,  researchers  tt'sted  the  e.vtcnt  of  agrceuK  fit 
in  solutions  by  dividing  participants  into  various  subgroups:  recruiter  and 
guidance  counselor  groups.  District  Recruiting  Command  > DHC )  subgroups 
(currently,  Command  Leadership  Teams),  etc.  Once  consistency  in  responses  across 
subgroups  was  established,  the  data  were  collapsed  across  all  subjects  and 
analyzed.  The  two  types  of  amalyses  performed  were  multidimensional  scaling 
MDt) ;  and  a  clustering  procedure. 

Results  indicated  that  people  in  the  different  DKCs  agrei'd  sutistan 
tially  among  themselves  about  the  pattern  of  similarities  among  tasks.  Guidance 
(ounselors  and  recruiters  agreed  closely,  and  supervisory  personnel  saw  much  thi* 
i.ime  pattern  of  task  similarities  as  those  they  supervised.  Since  no  sirrious 
disagreements  in  rffsponses  existed,  the  solutions  were  collapsed  .icross  the 
entire  sample,  and  a  summary  list  of  task  dimensions  was  formed  (Table  I  .  This 
composite  list  contfiined  lour  broad  dimirnsions  del'ining  gener.il  task  areas 
associated  with  the  recruiter’s  and  guidance  counselor’s  role  in  the  Armv 


tecruiLment  process. 

Boiman  et  al.,  believed  Lhese  dimensions  could  be  useful  in  develcjpin^ 
selection  procedures  for  potential  Army  recruiters.  They  believed  the  content  of 
the  dimensions  would  suggest  the  types  of  personal  characteristics  and  attributes 
necessary  for  effective  recruiter  performance.  Then,  paper-and-pencil  measures 
of  these  attributes  could  be  chosen  or  developed  as  indicators  of  potential  for 
top-level  performance  in  Array  recruiting  work.  The  authors  also  suggested  that 
the  dimensions  could  serve  as  performance  rating  scales  in  future  selection 
research  intended  to  ensure  that  selection  procedures  chosen  were,  in  fact, 
validly  identifying  ptirsons  with  good  potential  for  Army  recruiting.^ 

3.  Graham,  Brown,  King,  White,  and  Wood 

Graham,  Brown,  King,  White  and  Wood’s  1979  Army  Research  Institute 
study  described  structured  interviews  conducted  with  79  Army  recruiters  to  obtain 
information  on  the  nature  of  recruiting  duty  [Ref.  8].  The  sample  was  selected 
to  represent  recruiters  with  high,  medium  and  low  records  of  success,  in  terras  of 
percentage  of  quota  achieved.  Information  collected  from  the  interviews  was  used 
to  develop  hypotheses  on  the  personal  characteristics  and  job  behaviors  assoc¬ 
iated  with  recruiter  success.  These  hypotheses  were  to  be  evaluated  more 
rigorously  in  later  research. 

Interviews  solicited  the  following  types  of  information  from 
recruiters:  background  characteristics,  suggestions  about  recruiter  training, 

tlic  value  of  various  prospecting  anti  selling  techniques,  workload,  attitudes 

This  study  ciid  not  identify  personal  characteristics  and  attributes  of 
successful  Army  recruiters;  however,  Borman  is  currently  working  on  a  project  to 
develop  ptuformunce  based  rat  ing  sc;nles  for  Army  recruiters  similar  tti  work  lu; 
did  tor  the  N.ivy  in  1976  (telephone  discussion  November  1986). 
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Table  1.  Composite  list  of  recruiting  task  dimensions 

I.  Prospecting  activities 


Identifying  and  contacting  qualified  prospects 

using  existing  name  sources  to  generate  lists  of  prospects 
contacting  prospects 

dealing  with  centers  of  influence  and  other  persons  in  the  schools  and  in 
the  community  for  the  purpose  of  gathering  prospect  names 
obtaining  referrals 


II.  Publicizing  the  Army 

Building  a  positive  Army  image  in  the  community  by  setting  a  good  example  and  by 
providing  favorable  publicity  for  the  Army  and  Army  enlisted  programs. 

conducting  Army  publicity  programs  in  the  schools  or  in  the  community 
working  with  the  news  or  other  media  to  obtain  favorable  publicity  for  the 
Army 

performing  community  services  and  working  with  community  groups  to  enhance 
the  Army’s  image 

preparing  and  delivering  presentations  about  the  Army  to  civic 
organizations,  at  career  counseling  sessions,  or  at  recruiting  seminars 

III.  Selling  the  Army 

Getting  individuals  to  join  the  Army  by  counseling  them,  explaining  army  benefits 
and  opportunities  to  them,  and  presenting  the  advantages  of  Army  life. 

describing  aspects  of  Army  life,  benefits  and  opportunities  to  prospects 
-  conducting  interviewing  or  counseling  sessions  with  prospects  to  sell  them 
on  the  Army 

answering  questions  about  the  Army  and  about  enlistment;  overcoming 
objections  to  joining  the  Army  service 

sizing  up  individual  prospects  and  tailoring  the  interview  to  help  sell  Army 

IV.  Administrative  activities 

Working  with  recruiting  reports,  records,  statistics,  etc.,  and  organizing 
recruiting  activities. 

preparing,  maintaining,  and  reviewing  enlistment  reports 

planning  recruiting  activities:  performing  market  research,  zoning 

recruiting  areas,  etc. 

maintaining  recruiting  statistics  and  records 
maintaining  recruiting  publications 


Source:  Borman,  W.C. ,  Toquam,  J.L.,  and  Rosse,  R.L.,  Dimensions  of  the  Army 

Recruiter  and  Guidance  Counselor  Job. 
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toward  the  job,  personality  characterist ics  that  might  be  related  to  recruiter 
et'l'ect iveness ,  and  descriptions  of  successful  and  unsuccessful  recruiters. 

Responses  were  coded,  categorized,  and  analyzed  to  determine:  ,1/ 
personal  characteristics  and  job  behaviors  related  to  recruiter  production 
records  and  (2)  personal  characteristics  and  job  behaviors  attributed  (by  the 
respondents)  to  successful  and  unsuccessful  recruiters  they  knew. 

The  criterion  used  as  a  productivity  measure  was  the  percentage  of  the 
total  non-prior  service  (NFS)  quota  achieved  in  a  six-month  period.  The  authors 
realized  ..ne  limitations  of  this  measure,  but  felt  it  was  the  best  obtainable 
within  their  time  and  resource  constraints. 

Recruiters  were  placed  into  criterion  groups  of  high,  medium  and  low 
producers  bast;d  on  production  data.  During  the  interviews,  each  recruiter  w^is 
asked  to  think  of  one  successful  and  one  unsuccessful  recruiter  he  knew  and 
answer  questions  about  the  two  recruiters’  work  attitudes,  job  skills,  persona 
lity  traits,  etc.  Interview  responses  were  coded  into  broad  categories.  Rela¬ 
tionships  between  interviewee  responses  and  their  production  records  were 
explored  in  two  ways: 

a.  Comparison  of  high  and  low  producers  (chi  square  test).  The 

authors  hypothesized  that  high  and  low  producers’  scores  could 
differ  significantly  in  many  categories. 

b.  Correlations  between  presence  in  a  category  and  production  records 
Each  recruiter  was  assigned  a  score  of  0  or'  1  based  on  whcdhcr  or 
not  he  was  described  by  a  response  within  that  category.  Category 
sc.'ores  were  correlatetl  with  the  production  criter  ion  to  determine 
relationships  between  response  categories  and  the  criterion. 

The  authors  believed  many  recruiters’  responses  were  actually  elements 


i/I  a  st  etiioLypt!  of  the;  j{ood  recruiter,  which  Itiey  iiiuy  iiave  acquired  in  I  raining 
or  elsewhere,  and  not  based  on  actual  observations  of  the  respondent.  As 
indicated  by  Graham,  et.al,  peer  nomination  data  should  be  reuardeii  as 
recruiters’  opinions  of  what  it  takes  to  be  a  good  recruiter  t ather  than 
descriptions  of  good  and  poor  recruiters.  The  recruiters’  conceptions  ot  the 
successful  and  unsuccessful  recruiter  are  presented  in  Table  2. 

B’ew  of  the  characteristics  in  the  self-description  data  were  si(',ni 
ficantly  related  to  production  records.  Some  of  the  study’s  results  are  listed 
here. 

a.  Attitudes  Toward  the  Job  -  "Likes  independence"  cot  r  cd  atc>!l 

significantly  and  negatively  with  job  success  tr  -  .24t  sug¬ 
gesting  that  high  producers  were  less  likely  than  low  producers  !o 
cite  "independence"  as  a  source  of  job  satisfaction.  Recruiters 
who  commented  on  their  dislike  of  "long  hours,"  "the  f i us t rat  i iik 
nature  of  the  job,"  etc.,  tended  to  be  more  productive  tiian  tiiose 
who  did  not  make  those  comments. 

b.  Prospecting  Techniques  -  According  to  successful  recruiters,  this 
is  one  of  the  most  important  components  of  the  job.  The  objective 
is  to  bring  the  recruiter  into  direct  personal  contact  with 
potential  enlistees.  Successful  recruiters  emphasized  that  they 
spent  many  hours  daily  in  prospecting  activities.  Two  response 
categories.  "Uses  systematic  approach"  and  "Uses  Pre  induct  ion 
physical  cards,  mail-outs,  etc."  were  statistically  significant. 

c.  Selling  Techniques  -  The  ability  to  motivate  a  person  to  enlist  is 
believed  to  be  an  important  characteristic  of  the  succ.essfui 
recruiter.  Yet  none  of  the  selling  techniques  mt?ntioned  by 
recruiters  interviewed  were  significant. 


Table  2. 


Category 


CharacterLstics  differentiating  successful  and  unsuccessful 
recruiters;  peer  nomination  data 

Nominees 
(in  percent; 

Successful  Unsuccessful 
N  =  79  N  ^  79 

Motivations  for  becoming  a  recruiter 


Dislike  for  present  assignment 


Attitudes  toward  the  job 


Likes  the  work 

Likes  the  challenge  of  the  job 
Dislikes  the  high  pressure 
Dislikes  other  features 
Wants  anottier  type  of  duty 


Prospecting  techniques 

Uses  systematic  approacti 
Stresses  person  to  person  contact 
Uses  higti  school  CIs 
Uses  other  CIs 

Uses  PIP  cards,  mail-outs,  etc. 

Boc.'oraes  involved  in  community 
Passively  waits  for  prospects  to  walk  in 
Emphasizes  peripheral  duties 
Emphasizes  outside  interests 

Selling  techniques 

Uses  miscellaneous  effective  sales  techniques 
Uses  miscellaneous  ineffective  sales  techniques 

Communication  skills 

Is  able  to  communicate  effectively 

Has  difficulty  in  communicating  effectively 


Industriousness 

Has  high  achievement  motivation 
Hus  low  ai.h  1  evemen t  motivation 
Is  very  conscientious 
Is  (ureicss  about  details 
Seeks  ways  to  improve 

Keeps  inlOrmtul  on  everything  relaleil  to  job 


Table 

2.  i continued) 

Characteristics  differentiating 

successful  and  unsuccessful 

recruiters:  Peer  i 

nomination  data 

Nominees 

Cm  £ 

lercent  i 

Success  lull 

Uiisuc:cessl'u  1 

Category 

N  ^  79 

N  :=79 

Miscellaneous  Personality  Traits 

Friendly,  easygoing 

53 

4 

Oatgoing 

44 

0 

Synipathet  ic 

20 

0 

St  able? 

13 

0 

Happy,  humorous 

11 

0 

Light -hearted 

10 

0 

S  iiicere 

10 

1 

Withdrawn 

1 

17 

Shy,  self-conscious 

1 

17 

Lacks  self-discipline 

1 

11 

H.is  family  problems 

1 

13 

Inconsistent 

0 

14 

Host  i  le 

0 

13 

Emotionally  immature 

0 

10 

Resentful,  rebellious 

0 

10 

Source:  Graham,  W.R 

.  ,  Brown,  G.H. ,  King, 

William  L. ,  White,  L. , 

and  Wood,  M.D., 

A  Pilot  Study  of  ^ 

Array  Recruiters: 

Their  Job  Behaviors 

and  Personal 

Character IS t ics . 
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Communications  Skills  -  A  highly  successful  recruiter  must  be  able 
to  communicate  effectively.  One  category,  "has  (iifl'iculty 
communicating  effectively"  correlated  negatively  and  significantly 
with  the  production  criterion.  Thus,  high  producers  admiLti?d 
having  communication  problems  less  often  than  low  producers. 


e.  [ndustriousness  -  The  pilot  study  did  not  reveal  much  infor¬ 
mation  in  support  of  the  idea  that  hard  work  is  essential  for 
successful  recruiters.  Although  several  recruiters  described 
themselves  as  "motivated"  or  as  "self-starters."  These  responses 
were  not  significantly  related  to  high  or  low  production.  Only 
one  response  category,  "keeps  informed  on  everything  relevant  to 
job,"  differentiated  significantly  between  high  and  low  producers. 

f.  Miscellaneous  Personality  Traits  -  "Erapathetic"  correlated 
negatively  and  significantly  with  the  production  criterion.  The 
authors  suggested  that  empathy  seemed  to  be  a  highly  valuable; 
characteristic  for  a  recruiter,  yt;t  it  correlated  negativc;ly  wiMi 
success.  McHurry  suggested  that  high  empathy  may  be  e  handicap  to 
a  salesperson  unless  it  is  accompanied  by  a  strong  ego  drive  or 
will  to  win  [Ref.  8;  p.  21]. 


Some  questions  in  the  interview  asked  the  recruiters  I'or  tht;ir  opinions 


i 


I: 


about  selection  criteria  for  recruiters.  A  summary  of  responses  the  recruiters 
mentioned  most  often  and  the  percentage  of  those  responding  appears  in  Table  2. 


Table  3,  Recruiter’s  opinions  regarding  recruiter  selection 


Response 

Should  be  able  to  talk  to  people 

Should  have  well  groomed  appearance 

Should  want  to  do  the  Job 

Screen  for  quality  of  past  performance 

Should  have  "substantial"  length  of  service 

Should  enjoy  working  with  people 

Should  be  stable  in  finances 

Should  have  sales  experience 

Tell  them  what  recruiting  is  really  like 

Provide  two  months  of  OJT 

Should  be  outgoing 

Should  be  adaptable 


Percentage 
49 
33 
30 
28 
24 
20 
16 
13 
11 
1 1 
10 


Source;  Graham,  W.H.,  Brown,  G.H.,  King,  William  L. ,  White,  L. ,  and  Wood,  M.D.,  A 
Pilot  S_lu£ly  of  Army  Recruiters;  T^heir  Job  Uelui^yiqrs  and  Personal  Churact  er  i  s  1 1  cs . 
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4.  Hirabayashi  and  Hersch 

Hirabuyashi  and  Harsch’s  1985  effort  at  the  Naval  I’osttiraduule  School 
attempted  to  document  characteristics  of  excellent  Navy  Recruiting  Districts 
[Ref.  9].  The  authors  visited  and  interviewed  key  individuals  assigned  to  these 
and  other  Navy  recruiting  activities.  Interviews  were  representative  of  the  Navv 
Recruiting  Command;  current  and  previous  Recruiting  Command  commanders, 

commanding  officers,  executive  officers,  department  heads,  recruiters, 

recruiters’  supervisors,  trainers,  and  more.  Based  on  the  results  ot  their 
interviews,  the  following  list  summarizes  the  characteristics  of  successful 
recruiters. 

Successful  Navy  Recruiters; 

are  movers,  shakers,  and  salesmen 

are  hungry  for  success  and/or  promotion 

are  aggressive,  want  responsibility,  and  want  to  excel 

possess  outstanding  communications  skills,  a  fundamental  knowledge  of 
recruiting,  and  an  inherent  ability  to  deal  with  numbers,  sales,  and 
the  public 

are  ambitious,  extroverted,  and  like  to  meet  anil  talk  to  people 
are  positive,  cheerful,  enthusiastic,  and  self-motivated. 

C.  Test  Batteries 

1.  Wollack  and  Kipnis 

One  of  the  earliest  developments  of  a  test  battery  for  recruiter- 
selections  was  a  1960  effort  by  Wollack  and  Kipnis  at  the  Naval  Research  Field 
Activity  [Ref.  10).  The  buttery’s  thirteen  tests  and  inventories  measured 
fluency  of  expression,  knowledge  of  the  Navy,  interest  in  recruiting  activities, 
and  general  aptitude. 


The  study  used  commanding  officers’  nominations  of  effective  and  inef¬ 


fective  recruiters  as  the  criterion  measure  of  performance.  Items  that  dii' 
ferentiated  between  effective  and  ineffective  recruiters  beyond  the  .20  confi¬ 
dence  level  were  retained  for  cross-validation. 

Although  few  of  the  battery’s  items  and  scales  cross-validated  signi¬ 
ficantly,  the  study’s  results  suggested  that  inventories  showed  promise  as 
indicators  of  recruiter  effectiveness.  As  suggested  by  Borman  the  poor  cross- 
validation  results  may  have  occurred  because  raters  made  their  evaluations  of 
recruiters  based  on  reputat ion  instead  of  performance  or  because  many  of  the 
individual  differences  that  predict  recruiter  success  were  not  included  in  the 
battery.  [Hef.  3;  p.  4]. 

2.  Massey  and  Mullins 

Massey  and  Mullins  conducted  an  Air  Force  study  in  1966  to  design  and 
validate  the  Recruiter  Salesman  selection  test.  They  developed  an  eight 
inventory  battery  to  measure  qualities  such  as  empathy,  sergeancy  (friendliness 
and  sociability),  and  perseverance  which  were  hypothesized  to  be  desirable  in 
recru  1 1  ers. 

Predictor  variables  were  correlated  with  school  success  auid  supfsrvisor 
field  ratings.  Results  after  crossvalidation  indicated  that  the  battery  would  be 
useful  only  marginally  in  predicting  school  performance  and  not  at  all  in 
predicting  field  ratings.  The  authors  believed  the  supervisor  rating  criterion 
liad  caused  the  poor  results,  suggesting  that  it  was  contaminated  by  several  inter 
errors  such  as  "halo"  and  "leniency."  effects.  They  advocated  the  development  of 
.1  more  reliable  anil  valid  measure  of  recruiter  effectiveness, 
i.  Krug 

In  Krug's  1972  study  for  the  Navy  Recruiting  Command,  a  personality 
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tusL  was  deveioi^ed  and  administered  to  ofiicer  and  enlisted  Navy  recruiters  to 
determine  its  usefulness  in  predicting  sales  ability  [Ref.  12).  The  Lest,  i6PF- 
m,  was  a  variation  of  the  16PF,  a  highly  regarded  personality  inventory  widely 
used  by  business  and  industry  in  sales  selection  [Ref.  13;  p.  22]. 

In  addition  to  the  1967  version  of  the  16PF  questionnaire,  the  IbPF  m 
included  a  supplement  designed  to  measure  motivational  distortion  (a  lie  scale) 
and  strength  of  motivation  to  succeed  as  a  recruiter,  and  seven  biographi c:al 
items:  years  of  service,  age,  sex,  marital  status,  number  of  dependents,  years 
of  formal  education,  and  population  of  subject’s  Home  of  Record. 

Commanding  officers’  nominations  of  recruiters  from  the  top  and  bottom 
fifty  percent  of  those  on  recruiting  duty  at  the  time  were  used  as  the  criterion 
measure  of  performance.  Stepwise  multiple  regression  results  indicated  that  Liie 
typical  effective  Navy  recruiter  was  married,  had  more  years  of  formal  education, 
and  tended  to  be  warm,  outgoing,  dominant,  aggressive,  and  self-assured,  with 
relatively  conservative  political  views. 

The  Navy  Recruiting  Command  used  this  battery  to  screen  people  for 
recruiting  assignments  for  approximately  four  years  between  1972  and  1976. 
Active  duty  Navy  personnel  took  the  test  if  they  were  being  considered  for  a 
recruiting  assignment.  Those  who  scored  below  thirty-five  were  considered 
unqualified  for  recruiting  duty.  (A  score  of  sixty-five  was  recommended  by  the 
study  team  and  was  predicted  to  be  seventy-two  percent  accurate.  but  the  Navy 
Recruiting  Command  chose  to  use  a  score  of  thirty- five. )  Use  of  the  Lest  was 
discontinued  when  Navy  Recruiting  Command  and  the  Chief  of  Naval  Personnel  ( Pers 
502)  agreed  it  did  not  prt;dict  sales  ability  effectively  [Ref.  13;  p.  24!. 

4.  Arima 

In  his  1976  Navy  Postgraduate  School  study,  Arima  evaluateii  the  16PF  as 
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having  ILttii;  utility  in  the  selection  process  due  to  the  absence  ol  a  rc' liable 


and  valid  criterion  [Ref.  14].  He  called  for  job  analysis  and  behav Loral ly- 
anchored  rating  scales. 

The  development  of  a  recruiter  selection  procedure  must  be  preceded  by  a 
thorough  analysis  of  the  position  that  will  show  the  functions  performed  and 
the  relative  importance  of  the  functions.  It  will  also  be  necessfiry  to 
obtain  knowledge  as  to  the  types  of  behavior  that  are  necessary  to  carry  out 
these  functions  successfully  and  the  types  of  behavior  that  are  detrimental. 
There  is  nothing  new  in  this  approach  to  developing  behavioral ly  anchored 
rating  scales  which  could  provide  the  desired  list  of  behaviors.  Knowledge 
of  the  job  should  provide  the  material  to  develop  a  recruiter  selection 
procedure.  [Ref.  14: p.  129] . 

5 .  Larriva 

Larriva  applied  the  16PF--m  to  a  sample  of  Marine  Corps  recruiteis  in  a 
concurrent  validity  study  in  1975  [Ref.  15].  Annual  non-prior  service  accessions 
were  used  as  the  criterion  measure  of  peri’onnance.  The  test  did  not.  pnaiict 
well,  and  Larriva  suspected  the  criterion  he  used  had  caused  the  probiem.  He 
e.xperimented  with  several  performance  indices,  examined  predictor  criterion 
relationships,  and  chose  the  index  that  resulted  in  the  most  valid  multiple 
correlation  coefficient.  This  index  separated  urban  and  rural  recruiters  and 
corrected  for  geographic  differences  in  relative  performance  of  recruiters. 
Cross  validation  suggested  the  i6PF-m  might  be  useful  in  screening  for  the  Marine 
Corps  recruiter  job  [Ref.  3;  p.  8] . 

Borman  et  al.  objected  to  Larriva’s  method  of  criteria  selection, 
indicating  that  a  more  acceptable  (and  justifiable)  method  would  have  been  to 
define  a  precise  criterion  first  and  then  selt;ct  a  measure  that  would  providi: 
relevant  and  reliable  measurement  of  the  criterion  without  regard  to  the 
pr-edictors  I  Ref.  3;  p.  9|. 

H.  Abrahams,  Neumann,  and  Rimland 

Abrahams,  Neumann,  and  Himlund  used  the  Strong  Vocational  Interest 
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Hlank  vSVIBi  in  1973  to  develop  a  RecruiLi^r  Inter-est  Scale  ,RiS, 
selecting  Navy  recruiters.  Items  that  di f ferer t lated  between  the  most  and  least 
cff'cctive  recruiters,  based  on  commanding  officers’  nominations,  croraprised  the- 
RIS-i,  which  was  used  for  cross-validation.  The  top  quart  lie  i highest  HIS 
scores)  contained  three  times  as  many  effective  recruiters  as  did  the  bottom 
quartile.  The  bottom  quartile  had  three  times  as  many  ineffective  recruiters  as 
the  top  quartile.  Although  the  authors  stressed  that  a  better  criterion  of 
recruiter  effectiveness  was  needed  and  that  other  recruiter  performance  factors 
should  be  considered  in  future  validity  research,  their  study  suggested  that 
vocational  interests  might  successfully  predict  recruiter  effectiveness.  Ref. 
161 

7.  Graf  and  Brower 

In  1976,  Graf  and  Brower  also  had  some  success  with  a  version  o(  the 
Navy  RIS  modified  for  Marine  Corps  recruiters.  Although  the  Marine  Corps 
Recruiter  Interest  Scale  (MCRIS)  resulted  in  a  higher  validity  coefficient  than 
the  Navy  scale  for  the  Marine  Corps  sample,  the  MCRIS  was  not  cross-validated, 
which  made  direct  comparisons  impossible.  Although  the  authors  hud  used 
recruiting  officers’  nominations  of  above-average,  average,  and  below  average 
recruiters  as  their  criterion  meiasure,  they  called  for  a  miKc*  reliable  method  <>l' 
measuring  recruiter  performance  (Ref.  17). 

8.  Borman,  Hough,  and  Ounnette 

The  most  extensive  work  in  this  area  was  a  test  battery  developed  bv 
the  Navy  Personnel  Research  auid  Development  Center  ( NPRDC ) .  This  work  lias 
evolved  through  four  studies  over  the  past  ten  years. 

NPRDC’s  work  began  witfi  the  development  of  behav loral ly-based  rating 
scales  which  attempted  to  identify  improved  performance  criteria  lor  measuring 
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rocru-iter  el' fee  Liveness.  The  approach  was  bused  on  the  notion  tliut  acquir  im> 
valid  information  about  recruiter  effectiveness  meant  that  a  thoroui^ti  job 
analysis  and  criterion  development  effort  would  have  to  be  accomplished.  Their 
first  study,  published  in  197B,  identified  more  than  800  critical  incnients 
describing  different  facets  of  effective  anti  ineffective  recruiter'  performantc. 
The  study’s  suggested  predictors  of  Navy  recruiter  effectiveness  are  shown  in 
Table  4.  dief.  6i 

The  second  phase  of  NPliDC’s  research  involvetl  deve  I  opiiitrii  t  and 

validation  of  an  inventory  battery  to  predict  Navy  and  Marine  Corps  recruilt-r 
per I'ormance .  Basetl  partly  on  their  liLeraturtr  review  and  the  results  at  their 
rating  scales  study,  they  developed  a  trial  predictor  battery  that  includea 
sevtrrnl  personality,  vocational  interest,  and  biographical  items  ami  scai.-s. 

Battery  scores  were  correlated  with  performance  scorns  developed  1 1 niii 

supervisory,  peer,  and  self  ratings  and  from  six  months  ol  adjusted  production 
data.  They  attempted  to  control  for  differences  in  recruiting  opportunity  across 
geographical  locations  >  opportunity  bias).  Stanrlard  scores  were  devr'lofied  /'or 
eacti  recruiter  for  each  month  by  standardizing  each  month’s  production  data 
within  ear h  Navy  hecruiting  District  ( NRD ) . 

NPRDC ’ s  third  study  was  designed  to  expand  and  refine  the  original  Lesi 
battery  and  dett'rmine  its  valiility  in  prt'dicting  recruiter  performance.  The 
revised  battery  was  analyzed  to  determine  the  precision  of  new  items  in  measuring 
desired  constructs  and  whether  t hev  had  unproved  the  validity  of  the  or  iginal 
test  batterv.  Composite's  of  the  added  ittims  enlianced  the  validity  of  the  oio 
tiat  term’s  eoristruits  in  about  hiilf  the  eases.  Seales  derived  from  t  Iw  conslruets 
vilidiv  predict  eii  re<tuiter  effci  t  i  veness  ,HeT.  18;. 

N'l'RU(.’’s  final  Special  .Ass  i  giimeii  t  Batterv  consisted  of  three  parts.  the 
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SLronK- Campbell  Interest  Inventory,  a  self-description  inventory,  and  a 
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background  questionnaire.  Recruiter  potential  was  measured  through  a  selection 
composite  composed  of  four  subscales:  selling  skills,  human  relations  skills, 
organizing  skills,  and  overall  performance.  Scores  on  each  of  these  four 
"keys"  were  correlated  with  each  recruiter’s  production  data.  .is  indicated  in 
Table  5  each  of  the  "keys"  had  low  correlations  with  production.  The  correlation 
between  production  and  organizing  was  not  significantly  different  from  zero. 
When  the  four  separate  scores  were  summed  into  a  composite,  the  correlation 
coefficient  between  the  composite  and  production  was  .27.  Figure  1  depicts  the 
pattern  of  these  relationships.  Sixty-six  percent  of  the  recruiters  scoring  in 
the  top  20  percent  were  in  the  upper  50  percent  in  production,  compared  to  3d 
percent  of  those  scoring  in  the  lowest  20  percent. 


Table  5.  Validity  of  final  keys  for  predicting  production 

(N  =  194) 


Predictor  key 


Correlation  with  production 


Selling  skills 

09* 

«  ^4^ 

Human  relations  skills 

.23* 

Organizing  skills 

.13* 

Overall  performance 

.26* 

•  p  .01 

Source;;  Borman,  W.C.,  Rosse,  H.  L.  , 

of  a  Recruiter  Selection  Battery. 

and  Toquara,  J.L., 
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Figure  I  Percent  successful  recruiters  expected  where  upper  50  percent  are 
considered  successful.  Source:  Borman,  W.C.,  Rosse,  H.L. ,  and  Toquam, 
J.L.,  Development  and  Validation  of  a  Recruiter  Selection  Batterv. 


Several  personality  constructs  correlated  highly  with  various  aspects 


ol'  recruiter  effectiveness.  "Making  a  good  impression"  and  "Enjoying  heir.g  t  iie 
center  of  attention"  correlated  highest  with  selling  skills.  "Spontaneity, 
impulsivity"  and  ".imbitious,  working  hard"  ccereiated  highest  with  the  human 
relations  skills  category,  while  "Unhappy,  lack  of  confidence”  related  negatively 
to  human  relations  effectiveness.  "Order,  planning  ahead"  related  well  to 
organizing  skills,  and  "Leading  and  influencing  others"  was  the  construct  tiiai 
correlated  most  highly  in  the  overall  performance  category.  The  vocational 
interest  constructs  that  correlated  highly  with  performance  criteria  were 
interests  in  e.vtroverted,  dominant,  social,  and  leadership  activities  and 
occupations,  interests  in  sports  and  competitive  activities,  and  interests  in  law 
luid  political  activities. 

The  fourth  phase  of  NPRDC’s  work,  published  in  1.‘1U5,  strongly  v.onil  rnu-ii 
the  findings  of  the  earlier  studies.  In  concurrent  and  predictive  studies, 
Marine  Corps  recruiters  whose  scores  were  in  the  top  20  percent  obtained  27  and 
40  percent  more  recruits,  respectively,  than  recruiters  who  scored  in  the  lowest 
20  percent.  [Ref.  19]. 

9.  Brown,  Wood,  and  Harris 

The  1979  study  conducted  by  Brown,  Wood,  and  Harris  at  Liu'  .Arrnv 
Research  Institute  attempted  to  (1)  develop  a  valid  criterion  of  recruiter 
effectiveness  and  (2)  develop  a  test  battery  to  identify  those  must  likc'ly  to 
succeed  as  recruiters  I  Ref. 5].  This  study  explored  in  some  clepth  the  criterion 
problem  of  using  production  scores  contaminated  by  opportunity  bias  causi'd  bv 
characteristics  that  influenced  the  fertility  of  a  recruiting  territory  but  were 
outside  the  r'ecruiter’s  control. 

This  .'iRI  study  ident  ified  15  factors  that  might  cause  opportunitv  tiias 
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such  us  the  unemployment  rale  in  Lhe  territory,  uveraKe  number  of  enlistments  per 
recruiter  in  the  recruiter’s  District  Recruiting  Conuuand  ( DRC  ,  .imount  oj 
recruiting  experience,  etc.  A  sample  of  500  recruiters  was  chosen  I'andoraiy,  100 
from  each  of  five  Ai'my  Regional  Recruiting  Commands  nationwide.  Six  months’ 
production  figures  were  provided  for  each  recruiter.  Measures  of  each  ol  the 
opportunity  bias  factors  were  accumulated  for  the  market  area  of  each  of  Lhe  500 
recruiters . 

Stepwise  multiple  regression  was  used  to  predict  the  theoretical  yield 
of  a  recruiter’s  territory  using  12  of  the  15  territorial  factors  in  the  equation 
'  three  census  variables  were  excluded;.  The  three  best  predictors  were  "Average 
production  per  recruiter  in  subject’s  DRC,”  accounting  for  48  percent  of  Lhe 
variance  in  production  scores;  ".■iverage  market  share  for  station  /.one";  viiul 
'’Proportion  of  the  /one  that  is  suburban.” 

These  three  predictors  which  accounted  for  51  percent  of  the  variance 
in  production  scores,  were  used  to  predict  production  scores  for  each  recruiter. 
Benchmark  .Achievement  Scores  (BAS)  were  computed  by  dividing  total  production  bv 
predicted  production  and  multiplying  by  100.  The  BAS  were  thought  of  as  unbiased 
production  scores,  corrected  for  the  effects  of  three  important  terriloriai 
factors . 

The  authors  suggested  that  another  production  measure,  the  Simpli; 
Achievement  Score  ( SAS )  ,  might  be  .just  as  useful  as  the  BAS.  Since  ’’Average 
i‘ro(iuc't  I  on  Per  Recruiter  in  Sub.ject’s  DHC”  explained  the  most  varianci;  in  the 
regression  equation,  a  score  based  on  the  individual’s  performance  coraparc-d  to 
that  average  would  be  easier  to  compute.  i SAS  correlated  highly  with  BAS  r 
. 'lb  .  so  the  two  scores  were  practiirally  equivalent.; 

The  si-cond  ob.jective  of  this  study  was  to  develop  a  recruiter-  selection 


bat  tery. 


The  buttery  was  developed  bused  on  the  pilot  study  by  Gruhain  et  al . 


Ret'.  Oi  involving  interviews  with  79  Army  recruiters  with  high,  medium,  and  Low 
records  of  success.  Personnel  from  Array  Recruiting  Ht;ad(iuar ters  were  also 
consulted  about  traits  necessary  for  recruiter  success. 

The  selection  battery  consisted  of  12  paper-and-penci  1  inventor  l(;s  and 
one  verbal  performance  test.  Below  is  a  list  of  the  measures  included  in  the 
bat  tery. 

a.  Verbal  Fluency.  Recruiters  were  asked  to  make  a  sales  pitch  to  a 
prospective  enlistee  about  the  benefits  of  Army  life.  Presen¬ 
tations  were  scored  by  computing  the  ratio  of  the  number  of  words 
spoken  in  two  minutes  to  the  number  of  "ahs"  spol' — •  The  authors 
hypothesized  that  an  effective  recruiter  must  be  able  to  talk 
easily  in  a  variety  of  social  situations,  and  they  wanted  to 
measure  verbal  fluency  orally,  in  the  most  realistic  situation 
possible . 

b.  Suciabiiity  Measures.  Four  inventories  were  used  to  measure  a 

recruiter’s  sociability  and  affiliative  tendency.  The  authors 
iiypothesized  that  sociability  was  important  since  u  recruiter  must 
spend  so  much  time  interacting  with  people  (who  often  are 
strangers ) . 

c.  Achievement  Motivation.  Three  inventories  were  used  to  measure 
the  tendency  to  work  hard  to  achieve  self-appointed  goals.  This 
was  hypothesized  to  be  a  positive  characteristic  of  a  good 
recruiter. 

d.  Rmpathy  Measures.  Four  instruments  wore  used  to  measuic  the 
ability  to  unilerstand  the  point  of  view  of  others  and  the  drive  to 
win  or  complete  a  sale.  The  authors  believed  empathy  aloru;  is  noL 
enough.  The  successful  recruiter  goes  on  to  close  the  sale. 

e.  Reject  ion _ Tolerance  Measure.  One  inventory  was  used  to  measur  e 

tolerance  to  rejection,  rebuffs,  and  insults.  The  hypothesis  was 
that  the  successful  recruiter  has  a  higher  tolerance  for-  rejection 
than  does  the  less  successful  recruiter. 

f.  Respons  ib  i_U  tjy  and  _MaJ  ur  1 1  y  Measui'es .  Thrt.'c  instruments  col 

Lected  information  about  a  recruiter’s  ability  to  manage  his 
personal,  financial,  and  officral  duties.  Since  recruiters  spi-mi 
the  bulk  of  their  duty  Lime  working  without  superv  is  i  oti .  and 
since  they  represent  their  blanch  of  servne  to  the  general 
public,  they  are  expf?cled  to  manage  tin^ir  personal,  financial,  and 
official  duties  with  discretion. 
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When  the  time  came  to  administer  the  battery,  the  criterion  development 
project  mentioned  earlier  (BAS  and  SAS)  was  not  yet  completed.  Instead,  the 
authors  created  a  Composite  Supervisory  Rating  procedure  to  select  highly 
successful  and  very  unsuccessful  recruiters.  Recruiters  were  nominated  by 
supervisors.  The  best  were  used  in  the  High  Criterion  Group,  and  the  poorest 
were  used  in  the  Low  Criterion  Group.  The  battery  was  administered,  and  infor¬ 
mation  on  each  recruiter’s  race,  religion,  and  aptitude  scores  was  obtained  from 
Array  personnel  files. 

None  of  the  personality  measures  or  aptitude  scores  differentiated 
significantly  between  the  two  groups.  The  verbal  performance  teat  and  22  other 
items  differentiated  significantly.  These  items  pertained  to  work  habits,  style 
of  handling  finances  and  debts,  educational  background,  and  reactions  to 
challenging  or  stressful  situations. 

The  authors  suggested  that  because  recruiters  are  a  relatively  homo- 
geneou.s  group  required  to  meet  several  minimum  qualifications  (age,  rank,  GCT 
scores)  and  because  of  their  length  of  time  in  service  (mean  was  14  years)  the 
recruiters  may  have  had  similar  attitudes  and  opinions,  which  would  have  limited 
the  variance  in  attitude,  personal  preference,  and  personality  inventory  scores. 
(The  new  items  that  did  discriminate  were  mostly  from  the  Background  Information 
Form  and  Personnel  Questionnaire,  instruments  dealing  mainly  with  matters  of  fact 
rather  than  attitude.) 

If  the  authors  had  been  able  to  use  the  Simple  Achievement  Score  (SAS) 
they  had  suggested,  rather  than  supervisor  nominations,  perhaps  higher  validities 


might  have  resulted. 


Assessment  Centers 


'«q 


o 


I 


m 


IjAt 

iJM 


t 


1.  Borman,  Toquam,  and  Rosse 

The  IDHl!  Army  study  conducted  by  Borman,  Toquam,  and  Rosso  indicatcii 
that  assessment  centers  could  successfully  predict  recruiter  school  periormanct' 
even  with  a  sample  of  recruiters  that  hud  been  pre  screened  by  a  sojcction  p.uK-i. 
Assessment  centers  are  believed  to  be  particularly  valuable  for  selection  of 
individuals  for  sales  positions.  Assessment  centers  usually  involve  a  candidate 
undertaking  parts  of  an  actual  job  under  observation  and  are  adaptable  for 
training  for  these  jobs.  Under  this  approach,  trained  observers  rate-  pott-nlial 
recruiters’  performance  in  several  different  situational  exercises  that  simulaie 
aspects  of  the  recruiter  job.  Assessors  were  interested  in  personal  chatacLei 
istics  such  as  persuasiveness,  sociability,  flexibility,  and  practical  judgment. 

A  potential  problem  with  the  assessment  center  concept  is  1  he  assum 
ption  that  people  being  rated  want  the  job.  As  requirements  for  recruiters  iiavf.- 
grown,  the  Army  has  assigned  most  of  its  recruiters  involuntarily.  The  cost  and 
the  potential  gaming  by  the  candidate  reduces  the  feasibility  of  using  assessment 
center  ratings  to  select  recruiters.  In  the  IDBO’s,  the  Army’s  problem  had 
become  one  of  motivation  and  development  rather  than  selection.  So,  the  purpose 
of  the  assessment  center  shifted. 

Assessment  exercises  were  reduced  dramatically.  Instead  of  being  ust'd 
for  selection,  ratings  given  in  a  revised  recruiter  Development  Center  were 
designed  to  give  recruiter  trainees  a  realistic  job  pi'eview  and  positive  feedback 
to  enhance  their  motivation. 

2.  Weltin,  Frieman,  Elig,  and  Johnson 

Weltin,  Fiiedman,  Elig  and  Johnson,  in  a  1!1H.5  study  relatei]  the  t  at  mgs 
of  the  origintil  assessment  center  and  a  subsetiuenl  devtdopraent  cenit-r-  stimple  to 


Lhc  tuunber  of  contracts  the  new  recruiter  produced  m  the  first  yea:  on  the  job 
Ref.  22,.  Tfie  criterion  measure  attempted  to  account  for  geographic  differences 

in  sales  potential  among  recruiting  battalions.  Previous  work  by  Drown  et  al. 
Ref.  51  showed  that  production  per  recruiter  in  the  subject’s  battalion 
district-  accounted  for  48  percent  of  the  variance  in  production  scores.  Some 
.Army  recruiting  battalions  have  better  sales  markets  than  others.  To  control  for 
tliese  geographic  differences  in  sales  potential,  Weltin  et  al. ,  partialed  the 
number'  of  contracts  per  recruiter  achieved  in  his  battalion  of  assignment  from 
eacli  recruiter’s  perfonnance  score.  While  Borman’s  work  related  assessment 
center  ratings  to  training  performance,  this  study  evaluated  the  usefulness  oi 
the  ratings  fur  predicting  Job  performance  as  a  field  recruiter. 

The  assessment  center  sample  included  41  of  57  soldiers  who  had  taiicn 
till'  ur'iginal  buttery  of  assessment  center  exercises  in  Jt)81  and  compl>;ied  the 
training  course.  Each  individual  had  been  rated  by  trained  assessors  in 
exercises  that  Included  cold  calls,  interviews,  a  speech,  and  the  in-basket  1  work 
prioritization).  Other  predictors  included  training  school  grades  (written  test 
scores  and  instructor  ratings  of  telephone  and  interviewing  techniques;,  and 
scores  on  the  following:  a  test  battery  developed  to  select  Navy  recruiters,  an 
experimental  Army  test  battery,  and  the  Gordon  Personal  Profile  and  Invent. ory. 

The  development  center  sample  included  970  recruiters  who  were  rated  in 
the  center,  completed  training,  and  had  at  least  one  contract  their  first  year  on 
ttie  job.  Assessors  were  nut  trained.  Essentially  the  same  e.xercises  were  used 
as  in  the  assessment  c:enLer.  No  personality  or  interest  batteries  were  used. 
Written  training  gi'udes  were  available,  but  Instructor  ratings  on  telephone  and 
interviewing  techniques  wer  ('  not. 

Itesiilt.s  indicated  that  the  assf'ssment  center  ratings  had  low 


cutreLuLions  with  Job  porl'orraance;  however,  in  the  cleve LopmenL  ct;nt,er  s;unple,  the 
cold  call  interview  and  speech  exercises  were  significantly  related  to  job 
performance.  Training  grades  were  not  predictive  in  either  sampie.  The 
personality  and  interest  test  scores  significantly  predicted  Job  performance. 
.Vavy  test  scores  vhuman  relations,  selling  and  organising  subscales;,  i.he  Alii 
test,  as  well  as  two  scales  of  the  Gordon  Personal  Profile  and  Inventory,  showed 
moderate  relationships  with  Job  performance. 

Stepwise  regression  performed  on  the  development  center  sampie 
indicated  that  productivity  of  the  recruiter’s  battalion  was  the  singlt^  most 
important  factor  in  predicting  Job  performance.  Ratings  on  the  speech  e.xercise 
and  AFQT  scores  predicted  approximately  two  percent  additional  variance. 

K.  Personnel  Files 

1.  Bennett  and  Haber 

In  1973,  Bennett  and  Haber  investigated  various  factors  that  influence 
the  productivity  of  Marine  Corps  recruiters  [Ref,  23).  They  used  multiple 
regression  to  analyze  the  relative  importance  of  sixteen  variables  on  gross 
productivity  (average  number  of  recruits  enlisted  per  month).  Variables  were 


divided  Into  three  categories. 


Selection  variables  incrluded  General 


Comprehension  Test  scores,  age,  race,  level  of  education,  number  of  dependents, 
previous  service  as  a  career  planner  or  drill  instructor,  method  of  assignment  to 
recruiting  duty  (volunteer  or  assigned),  and  opinion  about  whether  recruiting 
duty  was  a  financial  hardship.  Deployment  variablt;s  included  whether  recruiters 
were  assigned  to  their  home  states,  distance  from  home  state,  type  of  area 
assigned  to  (urban,  suburban,  or  rural),  number  of  times  assigned,  hours  per  week 
spent  on  recruiting,  and  percentage  of  time  spent  out  of  the  office  recruiting. 
Evaluation  variables  included  riumbtir  of  months  on  current  tour  of  duty  and 


pfercentile  rank  in  Marine  Corps  recruiter  class. 


The  authors  noted  that  gross  productivity  was  determined  by  regionuJ 
differences  as  well  as  differences  in  individual  recruiters.  To  account  for 
regional  differences,  they  broke  their  sample  of  recruiters  into  two  groups:  one 
group  of  recruiters  from  recruiting  stations  with  high  enlistment  rates,  and  the 
other  from  stations  with  low  rates  of  enlistment. 

Several  variables  were  statistically  significantly  related  to 
productivity.  Results  from  the  high  enlistment  area  group  indicated  that  urban 
and  suburban  recruiters  enlisted  more  people  per  month  than  rural  recruiters,  and 
recruiters  in  their  home  state  enlisted  more  people  per  month  than  those 
stationed  more  than  500  miles  outside  their  home  state. 

In  the  low  enlistment  areas,  those  who  felt  recruiting  duty  was  a 
financial  hardship  enlisted  more  people  per  month  than  those  who  did  not. 
Recruiters  with  prior  service  as  career  planners  were  more  productive  than  those 
who  had  no  experience  as  career  planners.  The  regression  equations  were  not 
cross- validated. 

2.  Best  and  Wylie 

Best  and  Wylie’s  Naval  Postgraduate  School  study  hypotheis ixed  that 
recruiter  characteristics  could  be  combined  to  predict  recruiter  perfoi'mance 
[Ref.  24).  To  test  their  hypothesis  for  Navy  recruiters,  they  used  a  command 
evaluation  of  each  recruiter  in  their  sample  as  their  dependent  variable. 
Special  consideration  was  given  to  selecting  independent  variables  that  couhl  be 
obtained  easily  for  each  prospective  recruiter  prior  to  a  recruiting  assignment. 

The  authors  generated  a  cross- tabulation  of  the  independent  variables 
they  had  selected  initially,  and  they  retained  for  analysis  those  variables  with 
the  strongest  relationship  to  the  dependent  variable.  Those  variables  were;  the 


area  where  the  recruiter  had  spent  his  youth  (urban,  suburban  or  rural):  age; 
General  Comprehension  Test  (GCT)  score  (part  of  the  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB));  years  of  active  military  service;  and  proximity  of 
childhood  home  to  a  major  body  of  water,  grouped  into  three  distance  categories 
(less  than  20  miles,  20-200  miles,  and  more  than  200  miles). 

The  regression  equation  accounted  for  34  percent  of  the  variation  in 
the  dependent  variable.  Although  the  equation  failed  on  cross  validation,  the 
authors  believed  research  using  this  approach  should  continue.  The  only 
predictor  in  use  by  the  Navy  at  this  time  was  the  16PF-m.  As  discussed  earlier, 
this  test  battery  was  a  poor  predictor  of  recruiter  success  and  the  Navy  stopped 
using  it  for  recruiter  selection  in  1976  [Ref.  13;  p.  24). 

3 .  Shupack 

Shupack  attempted  to  develop  a  profile  of  a  successful  recruiter 
comprised  of  a  combination  of  objective  personal  characteristics  easily 

obtainable  from  existing  personnel  records  [Ref.  13].  She  regressed  six 
independent  variables  against  a  dependent  variable  designed  to  identify  success, 
mediocrity,  or  failure  in  the  recruiting  assignment.  The  independent  variables 
were  paygrade,  education,  years  of  service.  Navy  enlisted  entrance  test  scores, 
previous  rate  (occupation),  and  scores  on  the  16PF-m.  Her  measure  of 
effectiveness  was  defined  in  terms  of  Navy  Recruiting  Command’s  Honor  Roll  (five 
enlistments  per  month/.  Successful  performance  was  defined  as  completion  of  the 
twenty-month  test  period  and  some  level  of  Honor  Role  performance:  mediocre 
performance  was  defined  as  remaining  in  the  field  for  the  test  period  and  failure 
was  being  transferred  early. 

Using  multiple  regression  on  the  whole  sample  and  on  various  subgroups, 
the  explematory  factors  explained  a  low  fourteen  and  twenty-one  percent  of  the 


vat'iaiU-e  in  the  case  (jf  succc'ssfui  and  unsuccessful  r  c-cru  1 1  ets  ,  res;  ec  i  i  v(  •  i . 
Kclucatioii,  pa\)Jraile,  and  t.-n  L  ianc(-  ti'st  sc<jics  <-\plaituMl  t  tie  must  \at  lanie  ainoiu', 
successful  recru  1 1  et's .  For  unsuccessful  recruiter's,  tne  ijc-st  predictuis  weii- 
rate,  years  of  service,  and  enlranee  Lest  scor'es. 

1.  Elig,  Gade,  and  Johnson 

In  a  19113  working  paper,  Elig,  Jade  and  Johnson  descr  ibed  i  new 
approach  to  recruiter  selection  research"  iHef.  4;.  They  suggested  t  tiat  (jU'-vious 
selection  approaches  i b i ographica 1  information,  personality  assessment,  arui 
interest  inventories)  were  vulnerable  to  compromise  and  probably  would  not  le- 
useful  when  recruiters  were  selected  involuntarily.  Tliey  also  eoiimien  t  ed  on  t  !u' 
"criterion  problem,"  acknowledging  that  most  researchers  had  not.  1  ound  m 
,ide!(u;ite  per  t  (irinance  measure.  This  sl.udv  had  two  ob.jei  I  i  ves  ; 

1.  To  find  predictors  tliat  were  readily  av.ai  iali  ic-.  staple,  and  .secu;,. 
tneasures  ot  recruiter  character isl.  les,  and 

b.  To  establisli  criteria  that  were  readily  av.ailable,  ob.jecLive 

performance  measures  which  differentiated  among  recruit  chuiac 
teristics,  secure  and  were  relatively  free  from  "opportunity  bias." 

The  Enlisttid  Master  File  lEMF)  was  ijsed  as  the  data  source  tor 

r-ecruHc-r  demogfaptiic  ctiurac  ter  is  t  ics  and  the  Military  Enlistment  Process  uig 

Station  lieporting  System  ;  MHS  )  to  acquire  information  on  recruit  ehar.ai  t.cr  is  t  i  i.s . 

Botti  types  of  data  are  maintained  routinely  by  the  Army. 

The  authors  hypothesized  that  the  EMF  data  would  provide  measures  ol 

recruiter  characteristics  that  would  be  useful  in  predicting  productivity  as 

measured  by  recruit  characteristics  taken  from  the  MPS .  They  related  rinruiter 

characteristics  to  recruit  characteristics,  and  their  criterion  w;is  adjust.eil  fcjr 

oppor  t  un  1 1  %'  bi;is.  Brown  et  al.  Hef.  ■'’)  |  earlier  study  accounted  for  IH  (xacent 

of  an  individual  recruiter’s  total  proiJuct ion  by  using  average  total  production 

of  all  lerruiters  in  the  individual’s  District  FlecruiLing  Command  UPC'.  as  a 


pt  fcl  lit  Of .  KLig  ct  ai.,  adjusted  their  criterion  by  subtructint'  UltC  uveru^te 
production  from  the  taw  contract  totals  of  each  recruiter  in  the  DHC . 

rtie  sample  consisted  of  552  male  and  60  female  recruiters  on  production 
during  FY79.  Characteristics  that  correlated  with  contract  production  were 
identifieit  using  analysis  ot  covariance  techniques. 

In  this  study,  the  measures  of  opportunity  bias  ( DRC  Average 
Production;  explained  32  percent  of  the  variance  in  productivity,  compared  to  IH 
percent  found  by  Brown  et  al.  The  remaining  variance  was  believed  to  have 
resulted  t rom  unmeasured  opportunity  bias,  individual  recruiter  differences,  and 
mt-asuremen f  error.  All  effects  listed  below  were  significant  to  at  least  the  .01 


a.  Recruiter  Pducjition. 

Recruiters  with  post  secondary  eilucation  recruited  better'  eduiaii-d,  iiui 
Lower  AFuT,  male  recruits. 

b.  .U'OT. 

Recruiter  AFQT  co' related  positively  with  recruit  AFQT  in  its  ''prime" 
market,  high  school  diploma  graduate  and  senior  males  (HSDG/SR)  and  had 
little  impact  on  females  or  non-high  school  graduates  (NHSG). 

c .  Gender . 

Recruiter  gender  hud  no  effect  on  total  numbers  or  quality  of  recruits. 

d .  Age . 

Older  recruiters  contracted  more  male  and  fewer  female  recruits  than 
vounger  recruiters.  They  did  this  by  underproducing  high  AFQT  and 
overproducing  low  AFQT  recruits  in  the  HSDG/SR  market.  In  total 
production  younger  males  outproduced  older  males,  while  older  females 
outproduced  younger  females.  Younger  male  recruiters  outperformed 
their  female  counterparts,  while  older  females  outperformed  all  others. 

( • .  Rujik . 

Higher  ranking  ri?cruiters  achieved  success  in  the  HSDG/SR  market  by 
contracting  more  low  AFQT  I  category  IV)  recruits  than  lower  ranking 
recru 1 t  ers . 

f .  E  Lhn  • 

kike  recruited  like.  Black  recruiters  enlisted  the  most  Blacks, 
Hispanic  recruiters  enlisted  the  most  Hispanics.  Whites  the  most 
wh 1 t  es ,  e  t  c . 
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I'hi'  fi'sults 


LiidLcateil  that. 


fet.Tuittjr  demographic  ciiaracLefist  ics  may  be  f'latcii 


lo  recruit  ctiaracterisc  ics  when  opportunity  bias  is  removed,  and  Liiat  (iemoktrapiii.; 
Cat  a  may  lie  useful  for  seiectinf*  recruiters  from  a  non-volunt  (u.-r  pool.  tiowev  ei 
several  questions  remained: 

1.  Would  these  findiriRS  be  replicated  with  other  samples  and  in  otiui 
recruiting  environments  (e.g.  ,  where  unemployment  is  higher 

d.  Why  do  tradeoffs  exist  between  AFOT  and  education?  Recruiters  wno 
penetrated  the  HSDG/SR  market  will  so  at  the  expense  of  AFOT. 

a.  Are  these  relationships  likely  to  continue?  The  data  in  this  paper 
were  simple  correlations  and  were  not  tied  to  a  well  reasoned  theory. 
At  the  end  of  their  paper,  the  authors  mentiont;d  that  thev  woulii 
attempt  to  crossval idate  this  paper’s  results  and  develop  a  theoretical 
rationale  for  them. 

Differences  in  recruiting  performance  by  race  may  indicale  an 
intentional  opportunity  bias  because  of  deliberate  (but  unofficial)  stationing  -if 
minuriiies  in  areas  with  large  minority  populat.ions. 

Age  related  differences  in  performance  may  also  reflect  an  inhercuit 
opportunity  bias  in  the  case  of  older  (and  higher  ranking;  recruiters  who  often 
have  duty  assignments  (i.e,,  station  commander)  involving  responsibilities  in 
addition  to  recruiting. 

1 .  Overview 

This  r  eview  has  identified  e.xtensive  literature  on  the  recrui  t.er 
selection  problem.  Although  .a  considerable  .amount  of  relevant  work  has  been 
undertaken,  the  results  generally  were  disappointing.  Two  distinct  types  of 
factors  have  been  examined  for  their  utility  in  predicting  whether  or  not  an 
individual  would  be  a  successful  recruiter.  One  class  of  factors  includes  those 
for  which  intormation  can  be  found  in  standard  military  personnel  files.  Many 
studies  used  traditional  analytical  methods  such  as  regression  anulysis  to 
det.ermine  whether  re<;ruiter  productivity  could  be  pre<licted  by  various 
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ijomb  mat  iotis  of  factors. 


If  tliese  factors  could  be  identified,  Liiey  could  be 


used  to  select  for  recruiting  duty  those  individuals  with  the  highest  probabiiii-. 
of  success.  The  most  frecjuentiy  used  personnel  file  type  v.3riabies  were  age, 
gender,  rank,  education,  entrance  t.est  scores,  etc. 

The  other  class  of  factors  are  various  personality  chai'acter ist ics . 
'hist  studies  show  that  many  researchers  understood,  at  least  intuitively,  that 
successful  recruiters  possess  some  common  personality  characteristics.  A  wide 
variety  of  specific  tests  have  been  developed  to  measure  personality 
cliaracter ist ICS  and  have  been  used  with  varying  amounts  of  success.  Table  6 
suimnarii'es  the  Individual  characteristics  that  prior  studies  have  indii-aied  as 


Significantly  related  to  being  a  successful  recruiter. 


I'able  b.  Summary  oi'  characteristics  related  to  recruiter  success; 


,\ge  i  older  if  female,  younger  if  male) 
Marital  status 
Education 
I’uN  gi  ade 

Length  of  service 
\fOT  scores 
Racial  match 
flans  ahead 

Uses  systematic  approach  in  prospecting 

Knowledgeable  about  recruiting 

Sales  experience 

Verbal  fluency 

Persuasiveness 

Communicates  effectively 


Self-motivated 
Amb i t i ous 
Desire  to  excel 
Aggressive 
Dominant 
Confident 

Enthusiastic,  positive 
Mature 

Financially  stable 
Extroverted 

Enjoys  working  with  others 
Spontaneous 
Influences  others 
Well  groomed 


Most  of  tne  past  research  on  recruiter  selection  suffei'ed  from  one  or  more  ol'  the 
same  serious  I'laws;  poor  criterion  meiasuremen  t ,  lack  of  knowiedgi-  of  the 
recruiter  job,  and  f.ailure  of  results  to  remain  significant  upon  cr'oss- 


V- 
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vaiiiiatiun.  As  a  ffjsuit,  fitiditig's  of  many  of  tiiese  studies  are  of  ques  t  loiiab  ie 
vai ue . 

The  criterion  problem,  or  measuring  rt^cruitei'  performance'  in  a  reliaDie 
and  valid  manner,  was  probably  the  single  most  import<ant  reason  why  past  researcii 
expluined  relatively  little  variance  in  recruiter  productivity.  Hcscarchcrs  us.- 
various  measures  of  performance  as  their  dependent  variable,  such  as  supervisory 
ratings,  school  performance,  percent  of  quota  achieved,  and  total  number  oi' 
enlistments,  only  to  find  that  each  measure  suffered  from  its  own  set  of 
wcaiinc'sses.  for  cxairifile,  although  recruiter  production  I'ig.ures  wert;  casv  to 
obtain  and  use,  tiie  measure  was  contaminated  by  market  factors  not  reiateii  t<.) 
unlividual  r'.'cruiter  productivity.  Rese.archers  have  worked  on  this  prohiem  witii 
soiiK'  success,  but  more  work  on  incorporating  market  factors  itiKj  toiauiic! 
aiu.cess  modc'ls  is  needed. 

Recent  work  has  integrated  lessons  Learneii  from  earLK'r  stuiiics. 
Production  measures  have  become  more  sophisticated,  attempting  to  account  for  tiie 
powerful  influence  of  "opportunity  bias,"  or  the  effects  of  geographic,  socio 
economic  and  organ  mat ional  variables  on  individual  recruiter  productivity, 
i.'omprehens  I vc  job  analysis  has  provided  a  greater  unders t  antiing  oi'  what  LIk- 
recruiter’s  job  really  is.  Yet,  despite  the  increased  sophistication  of  recent 
work,  a  reliable  profile  of  the  successful  recruiter  is  still  not  gcniMallv 
agreed  upon.  Statistically  significant  findings  are  scarce,  and  very  few  results 
remain  significant  after  cross-validation. 

Further  research  nee<ls  to  be  undertaken  in  the  area  of  determining  an 
effii  lent  and  effect  ive  set  of  df'cision  crituriti  for  seleeting  individuals  with  a 
high  likeliiiood  of  becoming  successful  recruiters.  The  set  of  factors  identified 
in  table  b  ate  too  numerous  to  Ik;  efficient  for  selection  criteria.  They  must  b<' 
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ft^duced  to  a  jiiore  maiiageabU;  total.  Tliese  sets  of’  individual  attributes  should 


then  be  evaluated  to  determine  how  important  each  one  is  in  selecting  potentially 
successful  recrulttus.  Expert  systems  is  one  method  that  offers  promisi;  ot 
substantial  gains  in  obtaining  an  efficient  and  effective  set  of  selection 
criteria  for  identifying  potentially  successful  recruiteis. 


III.  METHODOLOGY 


A.  Multiattribute  Utility  Theory 

Traditional  methods  for  identifying  the  personal  characteristics  which  are 
associated  with  recruiter  success  rely  on  the  existence  of  reliable  and  valid 
measures  of  both  the  relevant  personal  attributes  and  of  recruiter  performance. 
The  literature  emd  data  review  in  Chapter  II  indicate  that  such  information  is 
not  available  from  personnel  data  files  and,  in  particular,  that  the  "criterion 
problem",  or  lack  of  a  measure  to  use  in  explaining  variance  in  recruiter 
productivity  based  solely  on  individual  differences,  prohibits  the  successful 
application  of  multivariate  statistical  techniques. 

The  process  used  by  USAREC  to  select  its  USAR  recruiters  is  subjective  and 
is  based  on  the  experience,  knowledge,  judgment  and  intuition  of  the  selecting 
officials.  (This  process  is  described  in  Chapter  I.)  Selection  board  members 
review  applications,  conduct  interviews  and  then  make  individual  evaluations  and, 
finally,  come  to  a  collective  decision  as  to  the  probability  that  an  applicant 
would  be  a  successful  recruiter.  One  approach  to  the  development  of  a  model  for 
recruiter  selection  would  be  to  incorporate  the  elements  of  this  subjective 
process  into  the  model-building  procedure. 

Some  experts  in  the  process  of  social  decision  making  believe  that  decisions 
do,  and  should,  depend  on  subjective  quantities  such  as  values  and  probabilities. 
Disagreements  over  policy  decisions  generally  hinge  on  disagreements  about 
values.  Often,  although  those  in  conflict  may  agree  about  the  relative 
dimensions  of  value,  they  disagree  about  the  relative  importance  of  various 
goals.  Some  aspects  of  value  are  matters  of  objective  information,  expertise,  or 
both.  [Ref.  25;  p.  326). 

Edwards  has  suggested  that  organizational  decisions  should  depend  on  some 


niiui  1)1  iiot  Lai  L.'unsen.sus  oi'  a>;)'rf>’.aLion  at'  individutil  vunva,  laiiua  i  hull  an  afi\' 
:..:u;Le  Lilli  1 V  L<iua  I '  3  vll'WS.  He  proposed  the  use  of  iiiul  t.  laL  L  r  ibut  a' 
ineasuiL-iiieii  t  as  a  solution  t  ii  the  problems  encrouiitered  in  this  arena.  This  moltiod 
>an  spell  out  explLoLtlv  the  values  of  eacli  group  part  leipant  ,  siiow  now  and  how 
IIIUL  n  t  hev  differ  and,  in  the  process,  reduce  the  extent  of  sucii  d  1 1' ferorict's  .lief, 
d  5  :  p .  3  d  7  .  . 

fdwurds’  measurement  technique  could  be  applied  to  tiSARliC’s  recruiter 
si'Iection  procedure.  Its  group  process  is  affected  by  differing  values  among 
group  members  and  by  taking  into  account  objective  infonnation  regarding 
recruiter  selection  as  well  as  relevant  expertise  among  group  members  or  other 
exaerts.  L'S/iiLEC  could  define  a  set  of  values  for  recruiter  selection. 

Fills  technique  is  based  on  e.xtensive  use  of  simple  rating  procedures.  Kvi.'rv 
ict'ision  may  have  value  on  ;i  nuniber  of  different  dimensions.  .Mu  1 1  lat  t  r  ibu  t  r 
utility  measurement  attempts  to  discover  those  values,  one  dimension  at  a  time, 
.uid  aggregate  them  across  dimensions  using  a  suitable  aggregation  rule  and 
weighting  procedure.  The  procedure  for  obtaining  group  consensus  has  ten  steps. 
Ti'.cy  are  listf;d  briefly  below: 

1.  Idcntil'y  the  person!  si  or  organ  izul  ion  (  s  )  whose  utiJ.it,  ies  are  to  be 
maximized. 

d.  Identify  the  issuels;  (decisionsj  to  which  the  utilities  iieedeii  arc 

relevant . 

'i.  Identify  the  entities  to  be  evaluated.  (for  the  Army  ReciuitiiiL’, 

Command,  these  might  be  recruiter  applicants.) 

1.  Identify  the  relevant  dimensions  of  value  for  evaluui  ion  ol'  iiic 

entities.  iSpecify  a  simple  list  of  goals  that  seem  important  for  t.hc 
purpose  at  hand. ; 

)■  Rank  the  dimensions  in  order  of  importunce.  This  ran  be  dour 

individually  or  in  groups./ 

b.  Rate  dimensions  in  i  mporl  arice ,  preserving  ratios.  How  much  mote 

import.int  is  one  dimension  than  another.^: 


Id 


I  .  Sum  Llie  imporLaiice  weights,  and  divide  eacfi  by  ine  suin.  rhi:= 

coinpuLat.  Lon  convei  t  s  importance  weight  s  into  meusurta',  whicti  are  similat 

to  probabilities. 

d.  Measure  the  location  of  each  entity  being  evaluated  on  each  liimiaision. 

9.  Caicuiate  utilities  for  entities  as  follows: 

Ui  -  W)  Ui  j  ,  and  Wj  -  I.  iiqii  i 

is  the  aggregate  utility  for  the  ith  entity  while  w ,  is  tin. 

normuliiied  importance  weight  of  the  Jth  dimension  of  value,  and  U;  >  i;; 

the  rescaled  position  of  the  ith  entity  on  the  jtii  dimension.  Tlius  w 
is  the  output  ol‘  step  7,  and  ui  j  is  the  output  of  step  d.  This 
equation  is  the  formula  for  a  weighted  average. 

10.  Decide  by  inaxiraii^ing  Ui  .  If  a  subset  of  i  is  to  be  chosen,  then  the 

subset  for  which  Ui  is  maximum  is  best.  [Ref.  25;  pp.  228-329'. 

B.  Expert  Systems 

The  applic-ation  of  the  principles  of  multiattribute;  utiliiy  theory  to  :i 

complex  decision-making  environment  such  as  recruiter  selection  requires  the  us>; 
of'  sophisticated  tools  for  e.xtracting  knowledge  about  recruiter  success  )  ii  t  or:; 
from  those  who  have  wide  experience  in  this  area.  Some  method  must  also  be  found 
for  weighting  the  various  factors  identified  by  individual  c'xperts  in  recruiter 
selection  and,  finally,  a  synthesis  of  expert  opinion  should  be  obtained. 

Expert  systems  technology  provides  an  approach  to  decision  making'  supp(a  i 
which  can  incorporate  multiattribute  utility  concepts.  While  there  is  wide 
diversity  in  tht;  structure  and  computer  reciu iremen ts  of  expert  or  know  1  edge  based 
systems,  recent  developments  have  made  some  systems  .available  for  use  with 

microcomputers  and  this  represents  an  important  potential  source  of  assistance  in 
the  development  of  models  for  personnel  selection  [Ref.  2BJ  . 

Ai'tificiai  Intel  1  igenci;  is  the  umbrella  term  ust;d  to  Utscribe  a  sei  ol' 
teclinolog  les  <iesigned  to  make  computers  imitate  aspects  of  human  thought.  Expert 
svstems  rilong  with  roliol  ics  and  nal.ural  languag'e  proc(;ss  i  ng is  one  speeitu 
direction  that  this  general  area  of  researcii  has  taken  | Ref .  27;. 

li'xpert  sv:;tc'ms  are  c;omputer  programs  which  use  (he  knowledi’e  of  experts 


about,  a  upecLl'u;  problem  to  simulate  the  upp  I  leu  t :  <jii  o/'  human  c.xp'if  i  me  e  aoi'.e 
the'  pfoblem.  Specific  information  .such  as  the  chaiacterist  les  or  r.a  t  u  i !  <  a 
ap[>Licants:  is  combined  with  proceduri.'s  for  drawing  inferences  ,.n<i  reacniin', 

conclusions  about  that  information  vi.e.,  the  selection  ilc’cisioii  .  Ftiese 
programs  are  quite  different  from  other  computer  pr'ogr'ams  in  tliat  I  In-v  use  ruies 
ihueristics)  to  reach  an  acceptable  solution  to  a  problem  raLiic-r  man  usiii); 
mathematical  analysis  (algorithms!  to  find  an  optimal  or  correct  solnt  ion.  The 
expert  system  program  itself  contains  a  set  of  instructions  which  enable  ii  to 
create  these  rules  or  procedures  by  querying  experts  in  Liu-  problem  area.  Ihc 
subjective  aspects  of  decision  making  which  characterize  solutions  to  com|'ie.\ 
problems  like  personnel  selection  can  thus  be  incorporated  into  the  program. 

The  steps  in  the  development  of  an  expert  system  ar'e  as  follows: 

1.  A  ’  toolbui  Ider  ’  or  designer  constructs  a  g«'ncral  progr:im  or  shell  whidi 
can  be  used  to  collect  knowledge  and  determine  rules  for  solving  manv 
specific  problems.  The  expert  system  building  tool  is  a  programming 
language  especially  suited  to  the  construction  of  knowiedge-hased 
systems.  LISP  and  PROLOG  are  the  two  languages  used  for  this  purprrse. 
There  are  many  versions  of  both  languages  available.  The  programming 
skills  necessary  for  constructing  an  expert  system  shell  "from  scral.ch” 
are  not  widely  distributed.  The  builders  of  particular  expert  systems 
frequently  acquire  these  shells  from  others  rather  than  building  them 
iRef.  2aj. 

2.  A  "knowledgt;  engineer"  is  someone  skilieii  anti  experienced  in  the  pt  o 
cess  of  obtaining  the  knowledge  of  e.xperts  in  a  field.  He  she 
interviews  "domain  or  area  experts"  who  ai'e  thosi.'  known  I'or  prouui  ing 
good  solu-  t ions  to  the  particular  type  of  problem  under  study.  This 
IS  called  the  "knowledge  acquisiLjon"  phase. 

The  knowledge  engineer  then  organizes  the  knowledge  he  or  sho  tias 
obtained  untl  det:idt;s  how  to  r<?prt‘senl  it  in  the  expert  svsteiii.  (luec 
techniques  used  most  frequently  in  building  e\pt?rt  svsieirs  .if'  rui’cs, 
semantic  nets,  anti  frames.  T'h>'  rule  baseti  method  u.ses  1 1'  (  orul  i  i  ion 

and  THEN  (action!  statements  anti  is  tiie  most  common  Iv  utilizeti.  !'h.' 
oi  Ikt  two  methods  ust:  a  n<-twot  k  ot  nodi.'s  coniieeted  hv  rel.it  ions  ind 
organized  into  a  iiierarchy.  Ea.'h  tt'chnique  suits  I  tie  refneseiit  ii  i  on  (ii 
part  iru  lar  kinds  of  knowledge  enusal  iinltages,  .ledui  I  i i  [u  oi  esses, 
rel.it  '  lonal  knowledge,  classification,  t;ti;.  iHei.  2'.J 

The  re.isoriirig  mechanism  .  "  i  n  f<  renet.’  engine"  used  bv  the  ja  oiq  .un  unich 


■  urittHiis  t  1r‘  (•v;j  i  u;i  t  on  oT  ,i  iicnii  i  • -m  iihI  cv  ;t  i  u;j!  1  iu,'  rui'.'s  ;n  Ijn.' 

know  ie(igt.‘  base  is  seie'i;i,t'(l  ov  I  tie  KriowledjJi-  t-ni^ineef  ami  ls  usuaii'. 
eittief  t'ofwat  ii  eiiai:iiin’,  ot  bai  Hwar  a  tiauimv,.  Kofwar  ii  eiiainiii);  ai 
tempts  to  feai-ti  a  i;<^a  t  given  some  ini'  ;  ii  siatr'  iv  is  "data  dt■i^'e•|l"  , 

while  bai  iiwarii  (diaining  wot  i\s  1  t  oin  a  n'.poltiesis  to  seek  tlie  e'Vidence 
data  tiiat  will  support  it. 

aomel  lines  ttie  users  of  e.xpia  t  sv-stems  progi  ams  acquire  this  part  of  the 
expert  system  > or  some  aspects  of  this  element;  from  knowledge  engi¬ 
neers  who  have  built  systems  to  solve  problems  similar  to  tlie  one  tiie- 
user  IS  addressing.  The  kinds  of  expertise  needed  for  knowledge  engi¬ 
neering  are  relatively  rare.  It  is  oftt'n  cost-effective  to  purchase  an 
"off  the  shelf”  expert  system  program  which  has  been  designed  so  tliat 
the  end-user  can  build  a  svstem  for  a  particular  applicalion  with  only 
verv  limited  understanding  or  knowledge  of  engineering  techniques 
,!lef.  dH,. 

d.  Finally,  tlie  user  of  the  e.xpert  systt'm  aonives  tlie  computer  software  by 
giving  the  program  specific  data  and  asking  for  a  choice  or  decision  to 
be  made.  E.xpert  svstems  have  been  used  successfully  to  solve  a  variety 
of  problems  such  as  medical  diagnosis,  budget  analysis,  automat ic 
speech  recognition,  and  mechunicai  design  specification.  Prolilems 
whicli  do  not  liave  a  unique  answer,  which  are  not  successful  Iv  solved 
using  aigoritiims,  and  for  which  there  are  experts  avallabie  are  cand i 
<iates  for  expert  systems  approaches.  Personnel  selection  falls  Inio 
tins  category  of  potential  application  areas  but  very  limli.ed  worii  iias 
been  done  as  yet  in  this  field  [Ref.  26 J. 

d.  An  Expert  System  for  Recruiter  Selection 

Tlie  peculiar  characteristics  of  the  recruiter  selection  problem  dictated  tue 
liioKc  of  jin  expert  system  that  would  support  a  decision  when  no  critc'rion 
variable  was  available  for  tiie  development  of  an  empirical  model.  Mainframe 
ir  lii'if.ial  intelligence  programs  often  can  deal  with  a  breadth  of  problems  which 
are  not  encountered  in  the  recruiter  selection  environment  and  would  have  made 
tile  ap[)licution  unnecessarily  complex.  The  expert  system  selected  for  use  in 
c-;<amini!ig  tiie  USAH  recruiter  c^uestion,  EXPERTS?,  provides  the  required  ability  to 
opciato  in  the  aiisence  of  a  well  defined  dependent  variable.  It  does  not,  embody 
neediesslv  complr-x  simulations  of  human  reasoning  and,  in  addition,  It  presents 
tile  1  literal  I  ion  ol'  experts  with  a  knowledge  base  anti  the  results  in  a  wav  tlial  is 
I'asilv  c  ider  stood  by  experts  and  other  users.  This  progr.'im  can  be  operated  wilii 


a  porsuiial  computer  and  thus  coii  be  used  at  many  more  locations  than  would  be  tue 


case  With  a  m£iinfr:une  e.\pc;rt  system. 

The;  developer  oT  EXPERTS?  has  classified  his  system  as  one  of  a  type  he 
calls  Quasiartificial  Intelligence  (QAI),  [Ref.  30j,  a  less  ambitious  variant  of 
ai'tificial  inteliigerice  lAI;.  QAI  systems  avoid  many  of  the  pitfalls  oi' 
traditional  AI  approaches  because  they  do  not  attempt  to  simulate  so  many  aspects 
of  human  reasoning  processes. 

These  systems  build  on  a  well-defined  format  for  the  probl£;m  spjice.  Math 
ematicaliy,  a  QAI  problem  space  is  hierarchical  and  geometric,  as  opp<is(;d  to 
linguistic  or  symbolic,  us  in  AI.  QAI  systems  present,  the  attributes  of  decision 
alternatives  by  means  of:  I )  well-structured  profiles  of  iiypotiietical  case 

data,  ratiu'f  ttian  by  descriptive  ptirnses;  ,2.  queries  rec|uiriiig  i*ithr;r  hiiiaia  .1 
probabal  1st  1C  judgments  on  the  part  of  the  experts:  or  laM  by  means  of  hvfjotiieti- 
cals  which  require  the  expert  to  rely  on  plausible  rules.  .Ref.  28,  p.dj. 

The  program  selected  provides  a  format  for  gathering  intuitive  knowledge 
quickly  from  experts  and  in  a  manner  that  permits  verifiable  estimuLion  of  tlii' 
trustwortiiiness  of  the  e.xpert  systems  that  emerge.  The  method  generates  hier  - 
archn,:al  profiles  of  hypothetical  filternat  Ives  ;  in  this  case,  i  i;(  ru  i  t.cts  .  The 
software  generates  attribute  values  for  each  profile  oi'  alternative  wliicii  opti¬ 
mises  the  probability  that  the  expert's  resulting  modc;l  coriectiy  represents  t he 
expert's  intuitive  knowledge.  I  Ref .  30;  p.  4[. 

D.  The  Successful  Recruiter  Model 

Figure  2  depicts  the  hierarchy  developed  to  model  the  profile  ol'  a  success 
fill  recruiter.  The  goal  of  the  model  is  to  identify  and  weight  the  charactet- 
isl  ICS  of  tile  sucifissl'ul  recruitei'  and  this  goal  appears  as  Ihe  node  al  i  h<  uqi 
of  the  iiierarchy. 
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Based  on 


l.he  LiLeraLure  review  and  on  discussions  with  experts  in  the  r(>- 


cruiting  field,  characteristics  believed  to  be  related  to  recruiter  success  were 
identified  (see  Table  6,  Chapter  II)  and  organized  into  logical  caLc;gorics. 
These  groupings  included; 

1.  Communicution  skills, 

2.  Demographic  characteristics, 
o.  Military  background, 

4.  Personality  characteristics, 

5.  Behavior  characteristics, 

6.  Specific  experience. 

These  "dimensions "  become  the  largest  branch  nodes  of  the  hierarchy.  The  charac¬ 
teristics  or  "attributes"  within  each  dimension  appear  bei''*-'  these  nodes  in  Fig¬ 
ure  2,  and  are  specified  as  follows: 

1.  CazBmunication  Skills 

Public  Speaking  Skills-The  recruiter’s  ability  to  stand  btd'ore  a  group 
of  people  and  convey  information  so  as  to  motivate  an  audience  is 
thought  to  be  an  attribute  a  successful  recruiter  possesses. 

Writing  Skills-Although  a  recruiter’s  job  involves  very  little  writing, 
it  is  such  a  large  part  of  connnuni eating  that  it  was  included  in  the 
model. 

Listening  Skills—Many  of  the  recruiters  who  tested  this  model  believe 
that  listening  skills  are  the  most  important  aspect  of  a  recruiter’s 
communication.  By  asking  open-ended  questions  and  carefully  listening 
to  an  applicant,  the  successful  recruiter  can  provide  Information 
targeted  specifically  at  the  needs  and  desires  identified  by  the 
individual . 

Infonning-The  successful  recruiter  has  the  ability,  to  recall 
information  necessary  to  inform  the  applicant  effectively  on  all 
aspects  of  military  life. 

Persuading-The  successful  recruiter  must  be  able  to  close  the  sale. 

2.  Demographic  Characteristics 

Age-. in  older  recruiter  may  not  be  able  to  relate  to  a  young  applicant, 
while  a  very  youthful  recruiter  does  not  have  enough  e.xperience  to  help 
an  applicant. 

Family  Support-An  aspect  of  recruiting  that  affects  the  probability 
that  a  recruiter  will  be  successful  is  the  issue  of  family  support. 
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particularly  of  the  spouse.  Uecruitiiig  duty  i)fti.-n  means  living  in 
areas  away  I'rom  a  iniiitai'v  conimunity  luid  services  the  fiuiiily  depends 
upon.  Living  away  from  military  commissaries,  e.xchanges,  and  medical 
facilities  can  create  or  increase'  financial  hardship  and  '  tress  lor 
families.  Recruiting  also  involves  long  hours,  weekend  work,  and 
travel  away  from  home. 

Armed  Forces  Qua  L  i  fy  mg  Test  ,  AFQT;  -  The  literature'  sug)>ests  tnni 
intelligence  is  directly  related  to  recruiter  success. 

College  Experience-  Educat ion  and  Armed  Services  Vocational  Aptitude 
Battery  (ASVAB)  scores  are  often  used  as  readily  available  measures  ol 
intelligence. 

Military  Background 

I'ay  article  riu'  recruiters  who  tested  this  model  ail  felt  that  the  most 
successful  recruiters  are  E-6’s.  E -5 ’ s  and  E-7’s  are  next,  end  K  d' s 
iikI  E  t)’s  last.  E-4’s  anti  below  do  not  possess  the  neccsstit  v 
(Experience  to  be  successful  and  E  -8’s  and  E-9’s  tend  to  i i m ida i 
app  I  ittaiils. 

Years  ol'  Seryica;  _^Ac‘tiyey  A  ro.'criiitftr  must  have  exix'r lericc  in  'hi 
si'rvice  in  order-  to  have  cred  ib  i  1 1 1 -y- . 

Years  of  Sery  u.'i>  ^  Reserve,'  For  reserve  n.-eru  1 1  ern ,  some  exp(.'r  i  ( m  e  i;:  a 
reserve  unit  is  necessar-y  in  order  to  siril  the  candidate-  on  teset  . '■ 
life. 

Personality  Characteristics 

Sei f-Image-The  successful  recruiter  has  a  positive  self  imagi;  and 
outstanding  military  bearing. 

Jntegr,!  ty-Th  is  attribute  was  often  si-lected  as  the  most  important 
characteristic  within  this  dimension.  .A  r'ecruiter  who  lacks  tins 
attribute  Is  likely  to  recruit  fraudulent  enlistments  anti  to  be  rcmonti 
curly  from  recruiting  duty. 

Extroverted- The  successful  recruit  er  is  interr-sted  in  othi-r  s  and  is 
outgoing. 

Sense  of  Humour  This  may  help  u  ret.ruiter  enjoy  the  job,  and  mav  ht-lp 
keep  him/her  on  an  <jven  keel  in  a  vtjrv  dtimanding  job. 

Feop  I  e- Or  1  en  ted  The  successful  recruiter  enjoys  working,  with  peogde. 

Behavior  Characteristics 

Self  starter  A  recruittEr’s  jot>  t-ntails  working  alone.  rtw-  reiiuitei 
must  be  able  to  motivate  himst?  I  f  /  herse  I  f  to  initiate  I  Ik.-  conipl(-te 
tasks. 


Cummitinent-Tu  be  successful,  the  recruiter  must  like  his/her  job  and  Lie 
cuinmitteil  to  it. 


F  lex  lb  1 1 1  ty- A  suciressful  recruiter  must  be  able  to  adar)L  to  lusher- 
environment  and  change  plans  on  a  moment’s  notice. 

A 1 1 en 1 1 on  to  Detail-To  be  successful,  the  recruiter  should  be  able  to 
plan  activities  over  various  time  periods.  He/she  must  also  be 
organiiit.-d  so  as  not  to  forget  a  single  detail. 

Decisiveness -The  successful  recruiter  must  be  able  to  make  a  decision 
on  his/her  own. 

6.  Specific  Experience 

Sales  Experience-Civilian  sales  experience  may  be  a  substitutr,-  for 
recruiting  experience,  since  recruiters  are  often  described  as 
salespeople. 

Public  Speaking  E.xper ience -A  person  with  {uiblic  spe^aking  experienif  has 
presented  information  to  groups  and  has  an  advantage  over  other 
rei;rui  ters . 

Counselling  Experienco-A  recruiter  with  prior  counsel  iing  cxf)ct  :  e 

has  advised  individuals  and  helped  them  to  make  decisions. 

For  each  of  the  six  dimensions  described,  the  model  will  generate  <i 

number  of  hypothetical  profiles  which  each  expert  will  evaluate.  The  software 

takes  the  expert  through  evaluations  of  attributes  within  euc.-h  dimc'nsion  and 

evaluations  of  the  relative  importance  of  dimensions.  A  specially  constructed 

s(.-t  oi'  attribute  values  is  constructed  for  eui.h  attribute  which  defines  the- 

dimension.  The  larger  the  number  of  attributes  within  the  dimension,  tne  more 

profilt.-s  the  system  will  generate  for  expert  assessment.  This  is  neci!ss!ir\  to 

provide  sufficient  sample  size. 

Each  profile  is  presented  in  graphic  i'orm  for  Lhf'  expert  to  examine, 
rc'fli-ct  on,  and  assess,  as  depicted  in  Figure  3.  For  each  dimension,  experts  use 
'tieir  own  knowledge',  experience,  and  intuition  (o  evaluate  i  nd  t  v  i  tiua  I  recriii!,-! 

I  and  1  (iates  having  profiles  of  attributes  for  that  dimension.  The  assi/ssment  is 
ii.ised  on  the  S(  ale  shown  at  the  bottom  of  the  graph.  I'hc  ('Xper  t  ('liters  a  scor(' 

r.o 
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U'om  00  to  09  depeti(ii2ig  his.  her  overuii  evaluation  of  that  individual. 
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proieiiure  is  I  ht2n  rc[)(':ited  for  each  dimension  in  the  model. 

Once  the  last  profile  has  been  evaluated,  the  software  completes  its 
mathematical  routines  iind  stores  functional  relationships  between  ;it,tribules  and 
dimensions.  Now  that  the  e.xpert  system  is  in  place,  it  can  evaluate  real  alter  ¬ 
natives  based  on  each  expert’s  expertise.  .\n  additional  profile  is  displayed  and 
evaluated  based  on  the  expert  system  just  created.  .\fter  the  expert  enters  his 
her'  iissessment,  tire  system  displays  its  predicted  value  of  that  expert’s  assess 
merit.  With  reasonable  care,  the  e.xpert’s  response  should  be  accurate  to  witlrin 
five  or  SIX  percent  of  the  system’s  findings. 

One  of  tile  most  important  evaluation  tools  contained  in  Llie  prugr.im  i.s 
‘  i:e  Fide!  it  >  index.  Tins  index  iiulicatos  how  succe-.'ss  fu  L  the  [irngram  was  in 
developing  an  expert  system  that  correctly  models  the  expert’s  own  intuitions. 
If  Fidelity  is  less  than  80  percent,  there  Is  a  strong  Indication  that  tlic 
expert’s  evaluations  were  inconsistent,  which  means  that  the  intuitive  or 
cognitive  processes  underlying  the  trxperl’s  assessments  were  not  used  in  a 
consistent  way. 

Relative  wirights  are  traiculaled  for  each  expert,  indic.iting  t.hi' 
relative  importance  of  each  attribute  or  dimension.  The  software  determines  l<ir 
each  expert,  the  shape  of  the  function  relating  each  attribute  to  the  diinension 
or  concept,  whether  it  is  positive  or  negative,  monotonic  or  non-monotonic, 
linear,  lonvex,  or  < oncavt;. 

Thi.s  iritermalinn  {)rovi<J<-s  the  o.xpert  with  a  better  understanding  of 
his  her  irituiiive  fnoeesses  and  personal  values.  Tiie  sign  of  the  non  Linear 
(omporieni  is  k  lunllv  the  second  derival  ive  of  the  t  onirepl  utuiei  eviiluatrori  with 
respect  to  the  i  1 1 1  r' 1  Ij  u  t  e .  I’ositive  signs  indu'ute  IJ -shaped  functions,  and 


neg.iLive  sigiia  iridicaLe  functions  whicii  rise  to  a  peak,  acce leral  iiiv,  <1  ,1 
decroasLiiH  pace;,  :iih1  then  reversinR.  [f  an  attribute;  tias  a  re*  1  at  1  ve  1 lar;M' 
Linear  component,  this  implies  that  the  value  of  ttie  concept  increases  linea; 
with  the  magnitude  of  the  attribute.  If  the  relative  weights  also  contain  a 
significant  negative  non-linear  component,  this  implies  a  leveling  off,  or  a 
reversal  of  this  trend  for  the  larger  magnitudes  of  the  attribute.  Ref.  dH;  pp. 
84-85] . 

At  no  time  does  the  program  ask  the  expert  to  indicate  the  import  am  i- 
of  each  attribute.  This  information  is  generated  by  the  program  based  on  tiie 
e.xpert’s  evaluation  of  profiles  of  individual  candidates  with  spet.-ific;  measut  t-d 
quantities  of  each  attribute.  The  Fidelity  index  is  then  used  as  an  Indicator-  of 
hovv  ac;c;urate  Iv  the  modt;  1  simulates  tlie  expert.  (Ref.  28;  p.  85  1. 

E.  Expert  Selection  and  Model  Application 

For  the  recruiter  selection  problem,  the  experts  selected  were  currently  on 
recruiting  duty  and  widely  regarded  as  successful,  or  recruiter  instructors  who 
had  been  successful  in  the  field.  Six  of  the  experts  were  AGR  recruiters,  four 
of  them  field  recruiters  from  Indiana  battalions  and  two  instructors  at  the 
rci.:ruiter  sctiool  at  Fort  Benjamin  Harrison,  Indianapolis.  Ten  additional  Active 
dutv  recruiter  instructors  at  the  school  were  also  included. 

This  test  group  is  very  small.  It  was  not  selected  to  be  either  a  random  or 
representative  sample  but  rather,  it  provided  a  conveniently  sized  group  for  use 
in  developing  and  evaluating  a  prototype  model.  Expert  systems  methodology 
usually  ptoieeds  in  this  way,  by  choosing  "recognized  experts,"  rather  than  by 
exliaustive  interviewing  of  many  sub.Jects.  Further  work  should  involve  using  the 
formal  foi  knowledge  acquisition  developed  hf're  to  elicit  responses  ( iom 
individual  e;<perts  ctiosen  by  those  who  .are  qualified  to  recognize  exceptional 
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abilLLy  in  recfuiter  selection. 

The  model  was  usetl  to  cre;uLt;  an  eexpert  system  for  each  of  ihese  1  (>  e.ypcr  i 
recr'Uiters.  Similarities  and  differences  among  the  expert  systems  aie  analyzed 
in  Chapter  IV.  In  addition,  a  composite  model  was  constructed  usiin;  tin?  mean 
scores  of  the  16  experts  and  this  is  compared  with  the  individual  models  as  w(- 1 1 
as  with  a  "patchwork”  model  which  represents  another  technique  for  combining  i ht- 
results  for  a  group  of  experts. 

Trends  and  relative  weights  lunong  dimensions  and  attribute's  werr-  also  con 
sidered  to  determine  if  a  consistent,  clearly  identifiable  profile  of  a  succoas* 
ful  recruiter  emerges.  Finally,  an  evaluation  of  hypothetical  recruiter'  arqj  1  i 
cants  was  examined  to  compare  the  ratings  of  the  same  applicants  by  all  tne  ex - 
systems. 
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rV.  ANALYSIS  AND  RESULTS 

A.  Dioensions 

Table  7  (USAR  recruiters)  and  Table  8  (RA  recruiters)  present  the  relative 
weights  assigned  to  the  model’s  six  dimensions  by  each  of  the  sixteen  experts. 
The  weights  in  each  column  sum  to  (approximately)  one  and  may  be  interpreted  as 
the  relative  importance  of  one  dimension  in  relation  to  the  others.  For  example, 
Expert  I’s  weight  for  the  Demographic  Characteristics  dimension  is  0.321,  which 
is  approximately  6  times  as  important  as  the  Behavior  Characteristics  dimension 
which  has  a  relative  weight  of  0.05.  A  more  detailed  display  for  each  expert  is 
contained  in  Appendix  A. 

The  weighting  schemes  (Tables  7  and  8)  for  the  two  types  of  recruiters  both 
show  the  greatest  relative  value  given  to  the  communication  skills  dimension 
(.285  for  USAR  and  .434  for  RA).  The  weights  for  the  other  five  dimensions  do 
not  follow  the  same  pattern  for  Reserve  and  Active  Duty  recruiters. 

Table  9  (USAR  recruiters)  and  Table  10  (RA  recruiters)  display  the  expert 
systems’  most  important,  second  most  important,  and  least  important  dimensions 
along  with  their  relative  weights  for  the  two  recruiter  groups.  Communication 
Skills,  Demographic  Characteristics,  and  Personality  Characteristics  were  the 
most  important  dimensions  for  the  USAR  Recruiters.  Military  Background  and 
Behavior  Characteristics  were  next  in  importance,  and  Specific  Experience  was 
judged  least  important  of  the  six  dimensions.  The  Active  recruiters  judged 
Communication  Skills,  Personality  Characteristics,  and  Behavior  Characteristics 
as  the  most  important  dimensions.  Military  Background,  Specific  Experience?,  and 
Demographic  Characteristics  were  all  much  less  important.  Hence,  the  main 
difference  between  RA  and  USAR  recruiters  lay  in  the  Demographic  dimension  which 
was  of  greater  importance  to  the  Reserve  recruiters. 


Table  7.  Relative  weights  of  dimensions, 
Reseive  recruiters 


Table  8.  Relative  weights  of  dimensions, 
Regular  Army  recruiters 


Expert 


Dimension 


Communication  Demographic  Military  Personality 
skills  characteristics  background  characteristics 


Behavior  Specific 
_ experience 


Table  L).  Moat.ieasl  iinpurtaiiL  dimens  ioii.s  , 
({eserve  recruiLerj; 


Expert 

Most 

iinpor  Lunt 

Second  most 
impi>rtanL 

[,eas  1 
unpor i an  t 

L 

Demograpliic: 
character ist ics 
.3:'i 

Communicat  ton 
skills 
.305 

Bcliav,  ioi 

character  IS  1  ics 
.  05 

«  > 

Conununicat  ion 
skills 
.299 

Specific 

experience 

.229 

Mill tary 
backgrounil 
.  045 

Communication 

skills 

.245 

Demographic 
characterist ics 
.  191 

M  i  1 1 1  ary 
background 
.  067 

4 

Military 
backgi'ound 
.  5 17 

Commun icat ion 
skills 
.  267 

Per'sonai  1 1  v 
c.liat  acLcr  i  ;  i  ■  s 

5 

Demographic 

characteristics 

.338 

I^ersona  1 L  t.y 
characterist ics 
.  118 

Sp<;(;  i  1'  1 1  ■ 
experience 

.  054 

6 

Communicat ion 
skills 
.277 

Personal i ty 
characterist i cs 
.269 

Specific 
exper  i  t;ncc 

.054 

Mean 

Communicat ion 
skills 
.277 

Demographic 
characterist ics 
.  173 

Spei;  1 !"  ic 
exper i enc*  • 

.  099 

i'.iD  1  ■ '  lU.  Most  /  L<->uat.  Liiipoi'Lant  cliint:iisioris ,  Hej'ular  Ai  my  rcjcr  u i  i  ct  s 


iMos  L 

impoftadl 


Second  most 
important. 


C  oinmuii  i  ca  L  i  (jn 
skills 
•  liHii 

Communicat ion 
skills 
.4J7 

Personal! ty 

characteristics 

.2Uti 

Cuaimunicat  ion 
ski  Us 


Betiavior 


Communicat ion 
skills 
.448 

Commun icat ion 
sk  1 1  is 
.2di 

Commun icat ion 
skills 
.881 

Communication 
skills 
.  842 

Commun i cat  ion 
skills 
.  402 

Coimmin  i  <  a  t  i  on 
.skills 
.484 


Personal 1 Ly 
character is  t ics 
.250 

Personality 

characteristics 


Dtjmographic 
ciiaracter  is  L  ics 
.172 


Behavior 


Commun i cut  ion 
skills 
.800 

Specif ic 
experience 


Personality 
character  is t ics 
.275 

Behavior 


Personal! ty 
characteristics 
.221 

Demographic 
characterist ics 


f'fM  sonal  i  ty 
character ist ics 
.  104 


Leas  t 
impoitant 


Specific 
exper  ieiKje 
.061 

Demograpiiic 
c;harac  ter  i  s  1 1  cs 
.048 

Communicai  ion 
skills 
.111 

Specific 
e.\pt-r  leiitre 
.021 

Specil'ic 

experience 

.020 

Personality 
character i s  tics 
.080 

Demographic 
character IS  L ics 
.075 

Personality 
fhiarac  t  er  is  1 1  cs 
.074 

Spec! f ic 
experience 
.071 

Beh.av  ior 


DcMoograph  i  c 
characterist ics 
.  0408 


a- 

i 
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Attributes 


The-  iiiiport  ance  of  the  attributes  within  each  ot  the  six  (iimens  i  oris  rs 
discussed  beiow.  Further  detail  for  all  attributes  within  dimensions  .s 
containeii  in  Appendix  A. 

1.  Communication  Skills 

The  attributes  within  the  Communication  Skills  dimension  an-  PuDiic 
Speaking  Skills,  Writing  Skills,  Listening  Skills,  Informing,  and  Persuading. 
Table  11  displays  the  Reserve  experts’  judgments  about  the  attributes  of  i  tie 
Communication  Skills  dimension.  Three  of  the  six  USAR  Recruiters  judgeej 
Persuading  most  important,  while  two  thought  Listening  was  most  important,  and 
one  felt  Informing  was  the  most  important  communication  skill.  Five  of  ihe  si.\ 
i'SAH  Ftecruiters  felt  Wr'iting  Skills  was  the  least  important  at.tt  i'oiiLe  in  tliis 
dimension,  and  one  indicated  that  Public  Speaking  Skills  was  least  important. 

Similarly,  the  Active  recruiters  judged  Persuading  as  most  important,  in 
seven  of  the  ten  cases,  as  shown  in  Table  12.  Two  felt  Listening  was  most 
important  and  one  considered  Informing  the  most  important  attribute  within  the 
Communication  Skills  dimension.  The  Active  recruiters  also  felt  that  Writing 
Skills  were  least  important  in  half  Lhe  eases.  Public  Speaking  Skills  were 
selected  as  least  important  in  three  cases.  Persuading  in  one  case,  and  Informing 
ui  one  case. 

2.  Personality  Characteristics 

The  Personality  Characteristics  dimension  includes  Self  Image, 
Integrity,  Extroverted,  Sense  of  Humor,  and  People-Oriented.  As  shown  in  Tables 
1  -  arui  11,  both  the  USAR  and  Active  recruiters  consistent  ly  ident  ified  tniegritv 
as  l.tie  most:  important  attribute  within  the  Personality  Characteristics  dimension. 
Sense  of  Humor  and  People  Oriented  were  judged  as  the  least  important  atlribute 


Table  li.  Cunununii.-al  i on  skills  dimension, 
most/ least  important  attributes,  Heserve  recruiters 


Most 

important 


Least 
import an  L 


Informing 

.291 


Writing 

.062 


Listening 

.252 


Writing 

.028 


Persuading 

.257 


Persuading 

.467 


Writ ing 
.041 


Writ ing 
.  OP, 8 


Listening 

.444 


Writing 

.051 


Persuading 


Public 

speaking 

.016 


Persuading 

.313 


Writ ing 
.041 


Table  IL’.  Communication  skills  dimension, 
most/least  important  attributes,  Rejjular  Army  recruiters 


Expert 

Most 

important 

Leas  L 
impin’ 1  an! 

7 

Persuading 

Wr  1 1  irig 

.333 

.  106 

'd 

Informing 

Persuati  j  nr 

.319 

.083 

d 

Persuading 

Pub  1  1C 
speak ing 

.466 

.  056 

LO 

Persuading 

Wr  i L ing 

.370 

.061 

LI 

Listening 

Pub  i  1 c 
spoaK  itm 

.318 

.  092 

12 

Persuading 

Informing 

.450 

.079 

13 

Persuading 

Wr i Ling 

.440 

.  033 

IT 

List  ening 

Public 

speaKing 

.332 

.  085 

15 

Persuading 

Wr  1 1  ittg 

.311 

.  024 

lb 

Persuading 

Wri t ing 

.346 

.024 

Mean 

Persuading 

Wri  1.  ing 

.  364 

.043 

VmV.V.V.' 
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Table  Li3.  Personality  eharacterisLics  dimens kjii 
must/ least  impoi'tant  attributes,  Rt^serve  recruit  c 


Most 

import  ant 


Self-  iniai'c 
.314 


Intefif'  i  I  V 
.608 


Integri ty 
.  440 


lal egr  1 1 V 
.  i33 


Int  tigr  i  ty 
.  507 


Integrity 

.358 


Leas  t 
itdport  irit 


l-’eop  I  e  or  I  (■!!  (  ', 

.  056 


Ex  t  r  ()  V(;r  t  t  ’(I 
.030 


Sense  ()i  iiujiiiir 

.  054 

[’x  t  re"/er  1  •,  1 1 

.  i/i  1 

Sensi;  of  huiiiot 
.030 


E.\t  rover  ted 
.  004 


Integrity 
.  540 


Si.'nse  o  i'  liujiioi 
.07,34 


Tabiu  14.  Pet'sonaiil.y  ciiaraiji,i.'M.s  L  ics  diinaiis  inn  , 
inost/ioasl  irapoflanL  uLliibuLas,  lii^y.ulur'  Atniy  t  ciimi  i  Let  s 


ixpert 


Mos  L 

import  an 1 


LiiipjorLan  (, 


Irileur  1 1  y 
.417 

IntopLri  ty 


Extroverted 

.339 

IntepLri  Ly 
.537 

Integrity 

.348 


Integrity 

.812 

Integrity 

..505 

Integrity 

.360 

Integrity 

.583 

Integri ty 
.618 


Sense  ol'  humor 
.045 

Self' image 
.  066 

People  oriented 
.032 

Pe<iple  oriented 

.070 

Sense  of  humor 
.  0784 


Si;nse  oi’  humor 
.  iOO 

Sense  of  humor 
.032 

People  oriented 
.062 

Sense  oi'  humot 
.044 

Sense  of  humor 
.039 


Extroverted 

.507 


Sense  of  humor 
.064 


wLihiii  this  (iiinfjnsion. 


h.  Behavior  Characteristics 

The  uLLributtJS  within  this  dimension  are  Sei  f  S  tarter ,  e'oinni  i  t  men  I  , 
t'Lexibility,  Attention  to  Detail,  and  Decisiveness.  Tables  15  and  16  rev.-ai  the 
(‘xperts’  judgments  within  the  Behavior  Characteristics  dimension.  IS.\H  .uni 
Active  recruiters  again  agree  in  their  judgment  of  Self-starter  and  Comraitmeni  as 
the  most  important  attribute  within  this  dimension.  Decisiveness  and  Flexibililv 
appeal'  most  trequentiy  as  the  least  important  attribute. 

i.  Military  Background 

Military  Background  attributes  include  Pavf’rade,  Years  of  Seri'iie 
Active)  and  Years  of  Service  (Reserve).  Among  tliese  attributes.  Tables  17  anu 
.)i  :ndicaie  i  hat  both  t  Vfies  of  recruiters  judged  overaU  experience,  as  imiicatc!' 
bv  I’aygrade,  to  be  most  important.  Reserve  recruiters  <;uns  idered  Active  liuf. 

•  ■xperience  least  important,  while  Active  Duty  Recruiters  gave  the  least  weigiit  to 
Reserve  experience. 

5.  Demographic  Characteristics 

The  attributes  within  the  Demographic  Characteristics  dimension  ai'c 
.\ge,  Family  Support,  AFQT,  and  College  Experience.  Tables  19  and  20  presens 
■  •valuations  of  attributoi;  on  this  dimension.  AFQT  and  Familv  buppoit  wen: 
consistently  judged  as  the  most  important  attribute  by  both  USAR  and  Aci  ive 
Rci:ruiters.  Almost  all  of  the  recruiters  considered  Age  and  College  KxpcrierKc 
re  lat  ive  ly  un  impor'tant . 

6.  Specific  Experience 

Specific  Experience  iruMudes  Sales  Experience,  Public  oiHaking 
Ex(ier  I  eiK  e ,  and  Counselling  Experience.  As  indicated  in  Table  21,  Reserve 
rc(  fuiters  eiriptias  i  zed  the  importance  of  Sales  Experience  and  gave  the  next 
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fioli.'  io.  Bfjhavior  ciiuruct  cm' ist  ict;  dimciris  ion , 
most , ioaat  important  attributes,  Reserve  recruiters 


Expert 


Mos  t 

important 


Leas  I 
i;iiporLant 


Attention  to  detail 
.  433 


F iexib  i  1  ity 
.Ooi' 


Commi tment 
.402 


Decisiveness 
.  iUl 


Seif-starter 

.329 


Decisivenei 


Seif  -starter 
.307 


Dec  IS  i  veness 


Self-starter 

.251 


Flexibility 

.095 


Flexibility 

.289 


Attention  to  detai 
.  093 


Self-starter 

.301 


Dec is  i  veness 
.076 


Tabli)  iU.  Behavior  chariictt*!' i s I  i c:s  dimension, 
most/ least  important  attributes,  Regular  Army  recruiters 


ibxpert 

( 

8 

'J 

10 

1  i 

lb 

lb 

14 

15 

lb 


Mos  L 

important 


Self-starter 

.27‘J 

Flexibility 

.380 

Self-starter 

.345 

Attention  to  detail 
.560 

Self-starter 
.  .  353 

Self  -starter 
.541 

Commitment 
.  504 

Flexibility 

.332 

Commitment 

.277 

Attention  to  detail 
.458 


Leas  t 

important 

Decis i veness 
.  lid 

Decis i veness 
.060 

F lexib  1 1 1 Ly 
.034 

Self-starl,  er 
.  038 

Attention  to  del. al 
.  i05 

becisiv('*ness 
.  035 

Attention  to  detai 
.  105 

F lexib i  li t V 
.088 

Commitment 

.081 

Attention  to  detai 
.058 

Decisiveness 

.087 


Mean 


Self-starter 

.312 


TaoLe  1/.  Miiilarv  bat;k)>r<;und  <1  imiins  i on  , 
most,  least  importaiit  attributes,  Reserve  recruiters 


bNper t 


important 


Least 

important 


YOS i R ; * 
.SL'B 


YOSi A)** 


Paygrade 

.846 


YOSi A; 
.  05  d 


All-O 


Pavgrade 

.472 


YOS  (  A  ;  e* 
.  141 


Paygrade 

.466 


Y0S( A)** 
.204 


Paygrade 

.561 


YOS  ( n 
.  L78 


Paygrade 

.595 


YOS  ■,  A ;  r*. 
.097 


*  Years  of  service,  Reserve 
•'t'Vcars  of  service,  Ai.tive  Duty 


laDle  18.  Military  backgr-aund  diinaiis  lun , 
most /  Least  iinpoi  lanL  attributes,  Heguiar  Army  recruiters 


E.sipert 


Mos  t 

iinportan  t 


L(.‘ast 
iiiipor  tan  i 


t  Vc-ars  ol  service,  Reserve 
**  Years  ot  siavuc,  Act,  ivt;  Duty 


i’aygr'ade 

.  44:1 


YOS  >  R  )  * 


YOS( A ) ** 
.  456 


Paygrade 

.li03 


Puygrade 

.624 


YOS ;  R '/  * 
.078 


YOS (k)** 
.  566 


YOS  i  H  * 
.  056 


Paygrade 
.  625 


YOS ;  ii ;  4 


YOSi  A  i 
.all 


YOS » It  * 
.076 


Paygrade 
.  422 


YOS ( R : * 
.  169 


Paygrade 
.  562 


YOS ( H . * 
.  065 


YOS(  A)-** 
.618 


YOS  :ii  :* 
.  1.32 


YOS( A)*» 
.440 


Paygrade 

.229 


YOS(A;** 

.498 


YOS ( R : ♦ 
.041 


Table  ID.  Oemogfapiiic  character  13  L  ics  diiiiens  ion  , 
mctil  least  itiipcr  i  ant  at  t  r  1  but  cs  ,  iit-serve  recrui  Li;rs 


Expert  Must  Least 

iinpurtanf  itupuilani 


1  AKQ'I'  Coiie>;(.'  e 

.J70  .100 

0  lamilv  support  .tKt-’ 

.5oy  .002 

;  AFOT  .h'c 

.82b  .027 

i  \rOT  .'.I'/' 

.  ■  >  O  o  .  1  .  j  i 

.\F0T  .Vj’At 

.aai  .0‘ib 


.xper  1 1  ■XK  i 


AFQT 
4' 


CuLie(>‘e  expert cnci 


Table  liO.  Demograpi.c  characterisLi.es  liinieiis ion , 
(n<ist/ least  LinpurtunL  alti-ibutes,  RejiuJar  Army  ri.'ct  u  1 1  ei  ;; 


Most 

important 


AFQT 

.4tiy 

AFQT 

.414 


AFQT 
.  4;jo 

Kami  I  suppoi  t 

.  ;160 

F.uoilv  support 

.  M 1 

Family  support 
.4911 

AFQT 
.  546 

AFQT 

.4911 

AFQT 

.707 

AFQT 

.508 


Li/as  t 
I mpor  t  an  t 


ram i 1 v  suppm 


r  nil  I  I  , III >1  "  a 


o'o  I  i  ego  I  ’Npor 
.  t)!JU 

(a)  I  1 1  UP’  o;.;pi  -r 

.  058 


1  lillisi' 


1  .1>’  I  (Mil  I 


t<<:nuiar-  Ar  mv  t  r-ct  ui  L  -t  s 


(jii  t  (jLiji': 


‘5 

b  ' 


11,11.  .1'.  iim  fi,:  !  Ill  ■■> 


1 1  uH  lion  o  t  h.xper  t  s 


■in*.  I'  ■  i  -I ■  1 


lui  II  ■  ■  :  1 .  '  '  ■  I  ino 


1  : i.  ,  li  •  1 


,  f  .  V*. 


■  •  *  •  '  V'  -l'  -  ■  -V-'’ik 


it  !  I  iDiili'n  in  1  <  (ins  I  si  i-nt  maiirif.’'. 


Tabie  21i.  Specific  expedience  diuiensiun, 
most/ least  impoi'tant  attributes,  He>(ulai'  Ai'iny  rt.'crui  tei's 


Expert 


Most 

important 


Least 
iinfjor  tan  L 


Counselling 

.647 


Public  spcakui)' 
.  153 


Public  speaking 
.453 


Sales 


Sales 

.470 


Counse  l i  iri)' 
.  205 


Public  speaking 
.448 


SaJ  es 


(ajunsei  ling 
.313 


Sa  1  es 
.  313 


Sales 
.  7 15 


Coutist,'  1  i  I  ru; 
.053 


Cuunse 1 1 ing 
.416 


Public  spiiaking 
.235 


Public  speaking 
.  520 


i.'ounsi;!  1  ing 


'oiinse  I  1  I  ng 
.  4HH 


S,i  1 1's 
.  I'j'; 


c'ounse  i  1  1 11)1 

.  1  i  3 


i’ubli*  xptaihiiu; 
,  .150 


'  outise  1  1  1 11)’, 
.  2t)4 


Table  211 .  Mean  validity  index  scores 
fur  expert  systems 


Reserve  recruiters  (n-6) 


Fidelity  index  Standards  index  Discrimination  uioc-x 


Overall  profile 

91.8 

73.7 

60.0 

Communicration  skills 

91.7 

62.5 

76 . 3 

Demographic 
char ac  (. er i s 1 1 cs 

92.6 

58.7 

67.8 

Military  background 

91.9 

47.5 

4 1 . 8 

i'l-r  sonal  i  tv 
hcr  ac  t  (..•(■  i  s  t  i  cs 

92.9 

72.6 

" ; .  o' 

!lt;'nav  i<jt 

^  iiat  iK  (  ct  IS i  1  cs 

91.8 

64.8 

Spei.  Li  ic  experience 

91.7 

46 . 7 

si;.  7 

Regular  Army  recruiters 

1 n- 10  / 

Ovi ‘f. 1 1  i  pro f  L  i (■ 

91.9 

60.2 

79.  1 

i uiiiriuii  H  n  1  1  on  skills 

90.9 

.54.4 

80 .  i 

U’  -liiog  t  jpn  i  1 

11. ir  : II  1  or  1  s  1  1  cs 

M).H 

5  1 . 4 

7  1.2 

'>1  1  1  1  1  or  v  loj(  ;kg  t  ouiii ! 

90 . 0 

48.3 

19 ;.  5 

:  ■  1  'll  III.  1  1  1  1 

Ii,  1 1  II  1  '  :  : .  1  1  ‘  ' 1 

89.  i 

( )7 .  .0 

87.9 

h  I  ■  1 1 . 1  .  I  '  r 

!  1  ■  1 1  : 1 1  It  t  1  .  1  1  '  s 

90. 1) 

0.5 .  1 

7  o . 

i  '■  ,  ;  .  '  •  I II  ■  t  1  '  '1 1'  '  • 

12  .  7 

1  ..  I  .  . 

most  lenient,  and  a  USAR  Recruiter  Instructor  had  the  highest  Standards  index. 
The  Standards  indices  for  the  individual  dimensions  varied  widely,  but  those 
experts  whose  Standards  indices  were  high  for  the  overall  model  tended  to  have 
higher  indices  than  the  other  experts  for  the  individual  dimensions  as  well. 

The  experts’  Discrimination  indices  ranged  from  18.1  to  103.8.  Expert  13,  a 
HA  Instructor/Guidance  counselor,  had  the  highest  Discrimination  index.  Expert 
I,  a  USAR  field  recruiter,  had  the  lowest. 

D.  Composite  Models 

In  order  to  obtain  composite  models,  two  different  methodologies  were  used. 

I .  Models  Based  on  Means 

Two  separate  models  were  developed  using  mean  values,  one  Cor  Reserve 
recruiters  (MAGH)  and  one  for  Active  Duty  (MRAi  recruiters.  To  construct  these 
models,  all  assessments  from  each  expert  were  sorted  by  concept  arnl  respon.se  ainl 
the  means  of  the  responses  were  calculated.  These  mean  values  were  then  entere,j 
into  the  expert  system  program  to  create  a  composite  expert.  The  overall  isoilel 
was  constructed  by  weighting  the  individual  dimensions  It  is  not  toe  simple 
iirithmitu'  mean  of  the  component  dimensions. 


for  both 

HA  and  U.SAH  mean 

expert 

systems.  111*’  overall 

mo<it? 

1  f 1 de 1  1 t  V 

1  ndex 

was 

'J7 .  and 

was  at  least  !lb 

for 

t  he 

individual  d i mens i ons . 

Ml.- 

St  aniliir  '(s 

I  ndex 

for 

the  overall  model  was 

HO 

for 

the  Reserves,  with 

t  he 

1  rxl  1  V  1  1 

dimensions  raiiging  from  4H.;i  to  H7 . 5 .  The  Active  Duty  Standards  Index  was  74  tiu 

the  .rverall  model,  .ind  range<l  from  4b. 3  to  74  tor  t  tie  individual  dimensions 

finally,  the  1)  i  scr  i  n  i  net  i  on  Index  for  t  h«-  H«*serves  was  t>3  (nr  the  over  nil  model, 
.uid  viir  ie<l  from  “id  to  bH  on  the  individual  dimensions.  The  t  ive  Hut  v 

retruiters  were  less  d  i  s<  r  i  la  i  naf  or  v  witti  an  index  of  41  tor  I  tie  ovei.ill  model, 

anil  a  range  of  ,38  to  b.b  for  the  individual  d  i  m«Tis  i  ons .  A.s  exf>e<  fe<l,  t  h**  use  ol 
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ri.-jects  only  four. 

In  ronirast,  MilA  and  PHA  (  l.lic-  Active  Duty  coinpustte  models  .  art;  surpr  i  s  ini' 1  y 
sLiniiar.  They  both  rank  B  and  L  first  and  second,  respectively.  Similarly,  MRA 
and  PRA  reject  .applicants,  (J,  F,  G,  K,  .N,  and  A  in  exactly  tlu;  samt;  order  with 
simil.ir  ratings.  PRA  also  rejects  H,  T,  and  D,  however,  while  MRA  selects  itiem. 


Table  24.  E.xpert  systems  evaluations  of  hypotliet real 
applicants.  Reserve  rtJcrulLers 


E.xpert 

1 

•7 

3 

4 

5 

6 

MAGR 

FAGR 

Rank  in>» 

B 

B 

B 

E. 

1. 

B 

E 

L 
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49.5 

62.2 

74.3 

55.0 

55.6 

73.2 

60.0 

71.0 

L 

E 

L 
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I 

L 

L 

P. 

•7 

49.2 

60.3 

68.6 

53.6 

51.3 

72.1 

49.2 

71.7 
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S 

S 

O 

.J 

49.0 

60.2 

63.0 

53.3 

50 . 5 

67 . 6 

48.5 
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59.3 

60 . 5 
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47.0 
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52.5 
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47. 5 

62 . 8 
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41.0* 
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48.3 
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49.8 
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58.2 

40.. 3* 

58 . 7 
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46.9 

47.4 
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57 . 1 
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U 
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45 . 3 
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EE 

1.: 

U).  .J 
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45.2 

35 . 9* 
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29.5* 
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6 

EE 
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46.8 

37.  G* 

42.1* 
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34.8* 

53 . 5 
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V.  CONCLUSIONS  AND  RECOM^NDATIONS 


A.  Past  research 

The  'iterature  review  in  Chapter  II  indicates  that  two  categories  of  factors 
Deen  identified  for  their  utility  in  predicting  successful  recruiter 
performance.  One  grouping  includes  biographical  anu  personal  history 

ctiur acter ist ics  vage,  education,  entrance  test  scores,  gender,  marital  status, 
etc.  which  are  available  in  standard  military  personnel  files.  The  predictive 
utility  of  these  factors  has  been  found  to  differ  widely  among  studies  as  a 
consequence  of  the  specific  predictors  selected  and  the  criterion  predicted. 

The  second  group  of  factors  shown  to  be  valuable  in  estimating  recruiter 
success  IS  comprised  of  measures  of  personality  and  behavioral  traits.  yeasui -'s 
of  such  characteristics  as  dominance,  self-confidence,  vocational  interc-st  m 
verbal  ability  are  much  more  difficult  to  obtain.  Likewise,  this  set  of  fai  t  or s 
has  yielded  disappointing  predictive  results.  Difficulty  in  conceptual..-.:;*, 
predictor-criterion  relationships  and  in  devising  objective  criterion  r 

has  limited  the  value  of  conventional  approaches  to  the  problem  of  ; r  : 


•  »  • 


i 

I, 


recruiter  success. 

B.  Expert  Systems 

This  study  applies  a  relatively  new  methodology,  expert 
recruiter  selection  problem.  This  technology,  a  t  r 

intelligence,  has  proved  particularly  useful  in  .leoiin*;  w,  ■ 
incomplete  knowledge  and  subjective  judgment  Tte-  ■ 

for  this  project  is  intended  for  moderate.! 
problems.  It  allows  efficient  interrut.  t  •  , .  . 

can  be  applied  to  the  development  ot  mo.ic.  .  •  • 
is  described  in  detail  in  Chapter 
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The  expert  systems  approach  addresses  a  major  shortcoming  of  traditional 


analysis  -  the  failure  to  specify  the  relative  importance  of  recruiter 
attributes.  A  weighting  algorithm  imbedded  in  the  expert  system  shell  produces  a 
multi-attribute  utility  model  from  the  expert’s  evaluation  of  hypothetical 
recruiter  candidates. 

A  second  important  advantage  of  expert  systems  technology  is  the  lack  of 
reliance  on  an  objectively  measured  criterion  for  recruiter  success.  This 
approach  avoids  the  problem  of  poorly  specified  and  measured  performance  criteria 
which  has  limited  the  usefulness  o'"  many  previous  efforts  to  model  recruiting 
success. 

Expert  systems  were  developed  for  6  Active  Guard  and  Reserve  (AGR)  Army 
recruiters  and  for  10  Regular  Army  (RA)  recruiters.  In  addition,  overall  models 
were  constructed  for  Reserve  and  Active  recruiters  as  well  as  two  composite 
models.  The  validity  of  the  systems  was  evaluated  by  the  expert  systems  program 
itself  on  the  basis  of  three  indices:  fidelity,  standards,  and  discrimination. 
All  the  systems  developed  for  recruiter  experts  showed  high  scores  for  these 
tests.  Twenty  hypothetical  recruiter  applicemts  were  screened  by  each  of  the 
expert  systems  and  a  fairly  consistent  pattern  of  selection  and  rejection 
emerged,  with  a  few  exceptions.  Chapter  IV  described  these  results. 

C.  Profile  of  the  Successful  Recruiter 

The  characteristics  of  a  successful  recruiter  may  be  inferred  from  the 
weights  assigned  to  individual  attributes  within  the  dimensions  identified  by  the 
expert  systems.  Recruiter  attributes  are  grouped  into  six  dimensions: 
Communication  Skills,  Personality  Characteristics,  Behavior  Characteristics, 
Military  Background,  Demographic  Characteristics,  and  Specific  Experience.  This 
hierarchy  of  attributes  is  based  on  the  findings  of  previous  studies  and  also 
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upon  the  opinions  of  experts  in  the  recruiting  field.  It  includes  both  the 
biodemographic  factors  and  the  personality/behavior  traits  identified  by  earlier 
researchers. 


On  the  whole,  Reserve  recruiters  Judged  Communication  Skills,  Demographic 
Characteristics,  emd  Personality  Characteristics  to  be  the  most  important 
dimensions  for  successful  recruiting,  while  Active  recruiters  felt  that 
Communication  Skills,  Personality  Characteristics,  and  Behavior  Characteristics 
were  most  important. 

Within  the  six  dimensions.  Reserve  recr”'t3rs  judged  Persuading  to  be  the 
most  important  Communication  Skill,  Integrity  to  be  the  most  important 
Personality  trait.  Self-starter  to  be  the  most  important  Behavior  Characteristic, 
Paygrade  to  be  the  most  important  aspect  of  Military  Background,  AFQT  to  be  the 
leading  Demographic  Characteristic,  and  Sales  Experience  to  be  the  most  useful 
type  of  Specific  Experience. 

Active  recruiters  made  generally  similar  judgments  as  to  the  roles  of 
attributes  in  the  dimensional  hierarchy:  Persuading,  Integrity, Self-starter,  and 
AFQT  were  all  considered  most  important  within  their  respective  dimensions,  while 
Years  of  Service  (Active  Duty)  and  Public  Speaking  Experience  had  the  strongest 

support  within  the  Military  Background  and  Specific  Experience  categories. 

Reserve  recruiter  -  experts,  then,  see  a  potentially  successful  candidate  as 
an  individual  who  is  intelligent,  persuasive,  self-motivated,  high-ranking  for 
his  or  her  length-of-service,  and  who  has  some  sales  experience.  Active 
recruiters  have  a  similar  ideal  candidate  who  possesses  public  speaking 
experience  rather  than  sales  experience  and  has  many  years  of  service  (Active 
Duty)  rather  than  high  rank,  but  with  otherwise  identical  characteristics. 
However,  these  profiles  are  far  too  limiting  in  that  the  expert  systems  models 
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give  a  role  to  every  attribute  in  the  hierarchy  and  develop  an  internally 
consistent  selection  tool  reflecting  all  of  the  characteristics. 

D.  Measurement  of  Personality/Behavior  Attributes 

A  major  impediment  to  the  implementation  of  expert  systems  methods  for 
recruiter  selection  is  the  lack  of  individual  data  on  personality  and  behavioral 
characteristics.  There  are  a  number  of  instruments  which  are  designed  to  measure 
such  traits  and  which  would  be  accommodated  readily  into  the  recruiter  screening 
process.  Several  of  these  widely  used  instruments  are  described  below, 
a.  Myers-Briggs  Type  Indicator  (MBTI) 

The  MBTI  test  measures  of  four  dichotomous  indices  of  personality  type: 
Extraversion-Introversion  (El),  whether  perception  and  judgment  are  directed 
toward  the  environment  or  the  world  of  ideas;  Sensation-Intuition  (SN), 
indicating  dominant  perceptual  style;  Thinking-Feeling  (TF),  which  one  of  these 
two  modes  of  judgment  is  relied  upon;  and  Judgment-Perception  (JP) ,  indicating 
which  of  these  is  relied  upon  in  dealing  with  the  environment.  The  test  consists 
of  166  forced-choice  (usually  two)  items.  Fifty- two  items  are  word  pairs  in 
which  respondents  indicate  a  preference.  Some  of  the  pairs  are  theory-certainty, 
build-invent,  casual-correct,  who-what,  sign-symbol  or  similar  to  the  following: 

Do  you: 

(1)  prefer  to  do  things  at  the  last  minute 

(2)  find  it  hard  on  your  nerves 

The  test  is  self-administering  and  has  no  time  limit,  but  usually  takes  about  50 
minutes  to  complete.  The  MBTI  is  easy  to  administer  and  score,  and  the  types  do 
have  the  virtue  of  being  mutually  independent.  A  draw-back  is  that  it  measures  a 
only  two  of  the  attributes  identified  (extrovert  and  self-image)  [Ref.  18;  pp. 


b.  California  Psychological  Inventory  (CPI) 

The  CPI  groups  eighteen  variables  under  four  classifications:  Class  I 
measures  poise,  ascendancy,  and  self-assurance;  Class  II  measures  socialization, 
maturity,  and  responsibility;  Class  III  measures  achievement,  potential  and 
intellectual  efficiency;  and  Class  IV  measures  personal  orientation  and  attitudes 
toward  life.  This  single  test  measures  most  of  the  attributes  identified  in  the 
expert  system  approach  to  profiling  the  successful  recruiter.  It  includes 
measures  of  self-starter,  extroverted,  people-oriented,  self-image,  flexibility, 
commitment,  and  indirectly,  integrity.  Integrity  could  be  measured  using  the 
variables,  responsibility  and  socialization.  They  are  defined  by  the  CPI  as 
follows: 

(1)  responsibility — indicating  seriousness  of  thought  and  manner, 
conscientiousness,  dependability  and  uprightness;  being  the  kind 
of  person  that  others  tend  to  trust  and  to  rely  upon. 

(2)  socialization — indicating  a  strong  sense  of  probity  and  propriety; 
acceptance  of  rules,  proper  authority,  and  custom;  a  person  who 
seldom  if  ever  gets  into  trouble. 

The  CPI  is  essentially  self-administering  and  consists  of  480 
statements.  The  18  scales  are  normative  and  are  based  on  over  6,000  males  and 
7,000  females.  The  raw  scores  are  converted  to  profiles  which  provide  graphic 
representations  of  standard  scores. 

Convincing  evidence  exists  to  validate  each  of  the  18  scales.  Even 
attributes  such  as  self-acceptance  revealed  significant  differ“ntiation  between 
high  school  students  rated  as  high  and  low  on  self-acceptance  by  staff  assess¬ 
ment  ratings  [Ref.  18;  pp.  37-40]. 
c.  The  16  PF 

The  16  PF  is  a  personality  test  designed  to  measure  an  individual’s 
personality  in  terms  of  sixteen  basic  factors.  It  was  used  successfully  in  a 


predictor  battery  for  a  Marine  Corps  Study  conducted  by  Larriva  [Ref.  15]. 
Several  of  the  factors  measured  by  the  16  PF  have  been  associated  with  recruiter 


success.  These  include  dominance,  aggressiveness,  self-confidence,  and 

spontaneity. 

E.  Testing  the  model 

The  expert  systems  approach  is  very  flexible.  An  appropriate  expert  system 
may  be  developed  and  tested  based  on  any  criteria  set  forth  by  the  Recruiting 
Command.  The  nature  and  structure  of  the  hierarchy  of  attributes  within 
dimensions  can  be  modified  easily.  An  expert  or  a  set  of  experts  could  be 
selected  and  the  program  used  to  extract  the  knowledge  necessary  for  use  in 
building  a  system  to  narrow  a  field  of  potential  recruiters. 

Initial  testing  might  involve  applying  the  model  to  recruiter  trainees  at 
entry  to  recruiter  training  school  and  then  tracking  the  performance  of  these 
students.  The  model  could  be  refined  and  modified  on  the  basis  of  such  tests. 
Finally,  the  model  would  then  be  useful  as  a  decision  support  element  at  the 
selection  board  level  or  at  the  Recruiting  Command  level.  Modification  of  the 
dimensional  hierarchy  or  the  expansion  of  the  knowledge  base  through  the 
inclusion  of  alternative  or  additional  experts  are  both  easily  accomplished  with 
the  expert  system  shell. 

F.  Work  remaining 

The  application  of  expert  systems  technology  to  problems  of  personnel 
selection  is  in  the  very  early  stages  of  development.  The  artificial 
intelligence  field  itself  is  rapidly  advancing  and  promises  to  provide  solutions 
to  many  difficult  questions.  Currently,  however,  there  are  severe  limitations  to 
the  usefulness  of  these  methods  in  solving  so  complex  a  problem  as  recruiter 
selection.  The  model  developed  here  does  succeed,  to  a  great  extent,  in 
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assigning  weights  to  personal  attributes  in  an  objective  manner  within  the 


context  of  an  unspecified  criterion  for  recruiter  success.  It  does  not,  however, 
simulate  the  intricate  processes  of  human  reasoning  which  are  involved  in  the 
selection  of  essential  personnel  by  a  large  organization. 

The  work  presented  here  is  preliminary  and  cannot  advemce  without  the 
development  of  expert  systems  techniques  to  accommodate  the  complex  nature  of 
such  decisions.  Expert  systems  is,  however,  a  very  promising  tool,  and  even  at 
this  early  point  of  development,  it  can  provide  assistance  in  structuring  the 
difficult  recruiter  selection  decision. 

There  are  several  areas  for  future  work.  One  is  the  construction  of  expert 
systems  shells  which  better  suit  the  specific  decision  problem  and  a  tailoring  of 
the  knowledge  acquisition  aspect  of  the  programs  to  suit  the  recruiter  experts. 
A  second  area  for  further  work  is  the  measurement  of  personality  and  behavior 
traits  for  recruiter  candidates  so  that  these  values  can  be  used  in  testing 
expert  systems  models.  A  third  task  is  the  continuation  of  research  into  the 
characteristics  associated  with  recruiter  success.  The  hierarchies  which  provide 
the  basic  structure  for  the  expert  systems  model  must  come  from  knowledge  of  the 
dynamics  of  the  recruiting  process. 
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APPENDIX  A 


The  Expert  Systems:  Profiles  of  'the  Successful  Recruiter  6y  Expert 


Expert  #1 

Communicat i on  Skills 


30 . 49 

Public  Speaking 
Skills  28 .19 

Writing  Skills  6.25 

Listening  Skills  25.03 

Informing  29.13 

Persuading  ll . 39 


Military  Background 
6.93 

Paygrade  23.72 

Years  of  Svc. 

(Act.)  23.72 

Years  of  Svc. 

(Res.)  52 . 55 

Behavior  Characteristics 


4.95 

Self-'^tarter  19.50 

Commitment  17,45 

Flexibility  5.13 

Attention  to 

Detail  43.33 

Decisiveness  14.58 


Demoqr aph i c  Character ist ics 


32 . 09 

Age  19 .17 
Family  Support  33.82 
AFQT  37 ■ 01 
College  Experience  10.00 


Personal i ty  Characteristics 
19.01 


Self-Image  31,38 
Integrity  29.43 
Extroverted  17.27 
Sense  of  Humor  16.36 
People-Oriented  5 . 56 


Sped  f  ic  Experience 
6.53 

Sales  Experience  45.18 
Public  Speaking  Exp.  30.90 
Counselling  Exp.  23.92 
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Prof  lie  of  the  Success  f ul  Recruiter 

Expert  #2. 


Cormnun icat  1  on  Skills 
29 .90 

Public  Speaking 


Skills 

8 .34 

Writing  Skills 

2.84 

Listening  Skills 

35.34 

Informing 

25.34 

Persuading 

27.64 

Military  Backqround 

4 . 52 

Paygrade 

84.57 

Years  of  Svc. 

( Act .  ) 

5.36 

Years  of  Svc. 

( Res .  ) 

9 . 57 

Demographic  Characteristics 


17.63 

Age  5.24 
Family  Support  50.39 
AFQT  38 . 22 
College  Experience  5.65 


Personality  Characteristics 
12.32 

Self-Image 

17.95 

Integrity 

60.84 

Extroverted 

2.90 

Sense  of  Humor 

10.66 

People -Or iented 

7.65 

Behavior  Character ist ics 
12.27 


)ec 1 f ic  Exper i ence 
22.87 


Self-Starter 

21.82 

Sales  Experience 

37.65 

Commi tment 

40.21 

Public  Speaking  Exp. 

5.44 

Flexibility 

16 . 49 

Counselling  Exp. 

56.91 

Attention  to 
Detail 

11.43 

Dec  is iveness 


10 .06 


Expert  #3. 


Profile  of  the  Successful  Recruiter 


Communication  Skills 

24.52 

Public  Speaking 
Skills 

9 .93 

Writing  Skills 

4 . 09 

Listening  Skills 

23 . 58 

Inform! ng 

26.74 

Persuading 

35.66 

Military  Background 

6 . 71 

Paygrade 

33  .  33 

Years  of  Svc. 

(Act . ) 

33.33 

Years  of  Svc. 

( Res .  ) 

33  .33 

Behavior  Character ist ics 

12 . 69 

Self-Starter 

32.32 

Commitment 

12.27 

Flexibility 

20 .76 

Attention  to 
Detail 

30 .01 

Demographic  Character ist ics 


19 . 09 

Age 

2 . 70 

Fami 1 Y 

Support 

27.32 

AFQT 

62.61 

College 

Experience 

7 , 36 

Personality  Characteristics 


18.75 

Self-Image 

24.16 

Integrity 

44.91 

Extroverted 

14 . 20 

Sense  of  Humor 

5.  43 

People -Or iented 

11 .30 

Specific  Experience 

18 . 23 

Sales  Experience 

33.33 

Public  Speaking  Exp.  33.33 
Counselling  Exp. 


Dec  is i veness 


4.14 


Expert  #4 


Pr of i le  o f  the  Successful  Recruiter 


Conununicat ion  Skills 


26 .68 

Public  Speaking 
Skills  10 . 26 

Writing  Skills  8 .78 

Listening  Skiiiis  13.21 

Informing  21.08 

Persuading  46.67 


Military  Background 
51.73 

Iciygrade  38 . 70 

Years  of  Svc. 

(Act.)  14.08 

Years  of  Svc. 

(Res.)  47.22 

Behavior  Characteristics 


8.62 

Self-Starter  30.67 

Commitment  13.39 

Flexibility  28.54 

Attention  to 

Detail  15.41 

Decisiveness  11.43 


Demographic  Characteristic 
5.18 

Age  13 . 08 

Family  Support  22.69 

AFQT  38 . 33 

College  Experience  25.90 

Personality  Characteristic; 
2 .30 


Self-Image  14.43 
Integrity  43.22 
Extroverted  6.07 
Sense  of  Humor  is . 19 
People-Oriented  20.03 


Specif ic  Experience 
5.49 

Sales  Experience  53.17 
Public  Speaking  Exp.  20.99 
Counselling  Exp.  20.84 


Profile  of  the 

Successful  Recruiter 

Expert  #5. 

Communication  Skills 

Demoqraphic  Characteristics 

14.01 

33.78 

Public  Speaking 
Skills 

17.82 

Age 

4  .75 

Family  Support 

33.33 

Writing  Skills 

5.12 

AFQT 

38 .03 

Listening  Skills 

44.44 

College  Experience 

23.83 

Informing 

25.06 

Persuading 

7 . 57 

Military  Backqround 

Personality  Characteristics 

14.71 

18 . 76 

Paygrade 

46.63 

Self-Image 

14.01 

Years  of  Svc. 

I ntegr i ty 

50.69 

(Act. ) 

23.96 

Extroverted 

16 .43 

Years  of  Svc. 

( Res . ) 

29.41 

Sense  of  Humor 

1.99 

People -Or iented 

16.88 

Behavior  Characteristics 

Specific  Experience 

Self -Starter 

Commitment 

Flexibi 1 ity 

Attention  to 
Detail 

Dec  is iveness 


25.09 
23.92 
8  ■  52 

18.04 

24.43 


Sales  Experience  14.41 
Public  Speaking  Exp.  35.01 
Counselling  Exp.  50.58 
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Profile  of  the  Successf ul  Recruiter 

Expert  #6. 

Commun i ca t i on  Skills  Demoaranhic  Ch 


Public  Speaking 
Skills 


Writing  Skills 


1.63 
8 . 33 


Listening  Skills  32.37 


Informing 

Persuading 


17.96 
39 . 71 


Military  Background 
7.60 


Paygrade 


Years  of  Svc, 
(Act.  ) 


Years  of  Svc. 
( Res .  ) 


56 .07 

26.09 

17.84 


Behavior  Characteristics 
22 . 79 


Demographic  Characteristics 


Age 

Family  Support 
AFQT 

College  Experience 


10 .99 
34 . 70 
4  4.51 
9 .80 


Personality  Characteristic 
26.90 


Self-Image 
Integr i ty 
Extroverted 
Sense  of  Humor 
People-Oriented 


17.42 

35.81 

9.40 

10.25 

27.13 


Specific  Exper i ence 
5 . 40 


Self-Starter 

28 . 39 

Sales  Experience 

42.18 

Commitment 

16 .34 

Public  Speaking  Exp. 

28.45 

Flexibi 1 ity 

28.85 

Counselling  Exp. 

29 . 38 

Attention  to 
Detail 

9  .28 

Dec  is i veness 

17 .13 

Profile  of  the  Successful  Recruiter 


Expert  MAGR 


Conanunicat ion  Skills 


i: 

Public  Speaking 
Skills  8 . 16 

Writing  Skills  4 .14 

Listening  Skills  30 . 50 


Informing 

Persuading 


25.90 


31.29 


Military  Background 
14.66 


Paygrade 

Years  of  Svc . 
(Act.  ) 

Years  of  Svc. 
(Res.  ) 


59 . 52 


9.67 


30 .81 


Behavior  Characteristics 
13.63 


Self-Starter 

Commitment 

Flexibi lity 

Attention  to 
Detail 

Decisiveness 


30.06 


27.01 


23.01 


12.04 


7.61 


Demographic  Characteristics 


17.33 


Family  Support 
AFQT 


2.90 


34 . 25 


50 .97 


College  Experience  11.38 


Personality  Characteristics 
16.73 


Self-Image 

Integrity 


Extroverted 


Sense  of  Humor 
People -Or iented 


Specific  Experience 
9.94 

Sales  Experience 


17.04 


53.95 


11.57 


7.37 


10.07 


45.15 


Public  Speaking  Exp.  22.82 


Counselling  Exp. 


32.03 


lie  of  the  Successful  Recruiter 


Expert  #7. 


Conununciation  Skills 
28.28 

Public  Speaking 
Skills  18.34 

Writing  Skills  lO . 57 

Listening  Skills  23.66 

Informing  14.12 

Persuading  33.31 


Demographic  Characteristics 
9.77 


18.34 

Age 

3.78 

Family  Support 

33.92 

10 . 57 

AFQT 

43.87 

23 . 66 

College  Experience 

18 . 54 

14 . 12 

33 . 31 

Military  Background 
13 . 70 

Paygrade  44.32 

Years  of  Svc. 

(Act.)  32.15 

Years  of  Svc. 

(Res.)  23.52 


Personality  Characteristics 
24.99 


Self-Image 
Integrity 
Extroverted 
Sense  of  Humor 
People-Oriented 


29 . 50 
41.66 
17.53 
4  .  46 
6 .85 


f 


Behavior  Character ist ics 
17 . 12 


Spec i f ic  Experience 
6.13 


Self-Starter 

27.94 

Sales  Experience 

20.04 

Commitment 

19 .23 

Public  Speaking  Exp. 

15.27 

Flexibi 1 ity 

15.98 

Counselling  Exp. 

64 . 69 

Attention  to 
Detail 

24.94 

Dec  is i veness 

11.90 

J\ 


I 


I  ^ 


'il*" 

•» 


* 


Public  Speaking 
Skills 


Writing  Skills 


20.13 

10.45 


Listening  Skills  29.27 


Informing 

Persuading 


31 .91 
8 .25 


Mill tary  Background 
3.53 


Paygrade 


20.33 


Years  of  Svc, 
(Act.) 


Years  of  Svc. 
( Res .  ) 


45.58 

34 . 10 


Behavior  Characteristics 
10 .60 


Age 

Family  Support 
AFQT 

College  Experience 


32 . 56 
7 .78 
41.38 
13 . 29 


Personal ity  Characteristics 
25.65 


Self-Image 
I ntegr i ty 
Extroverted 
Sense  of  Humor 
People -Or iented 


6  .  58 
35.18 
12.21 
11.59 
34 . 45 


Spec i f ic  Experience 
11.81 


Self-Starter 

9 .44 

Sales  Experience 

22 . 27 

Commitment 

35.56 

Public  Speaking  Exp. 

45.32 

Flexibi 1 i ty 

37.95 

Counselling  Exp. 

32  .  41 

Attention  to 
Detail 

11.02 

Decis i veness 

6.03 
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^  1 


•  of 


mmm 


Atcention  to 
Detail 

D-jc  is  i  veness 


56 .8^ 
1  3.13 


'-I  i  1  i.  tar  V  lack 

1  r  ;j  u  n  ; 

Personal ity  Characte 

r  i  -  1  ’  * . 

]  3 .  :■: 

5  .  a  C-, 

'-..•jygrade 

Seif -Ima  je 

1  •! .  5  ■; 

Y e a r a  of  3 '. c  . 

Inte^r i ty 

j  2  .  ‘ 

(Act.  ) 

5  ,3  .  6  1 

Extroverted 

10 .54 

Years  of  Svc. 

( Res  .  ) 

5.53 

Sense  of  Humor 

14  .  27 

Peopl  :-Or iented 

7.02 

Eehavioc  Char 

acter ist ics 

Specific  Experience 

21  . 

2 . 0  3 

Je i f -otar ter 

3.75 

Sales  Experience 

26 . 06 

C  0  mm i t  me  n  t 

9  .70 

Public  Speaking  Exp. 

4  4.73 

rle.<ibility 

11.51 

Counselling  E;<p. 

29 .15 
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I 


Attention  to 
Detail 


10,53 


Jec  .  s 1 ve  nes3 


S  ‘iCCt} 

3  3  f  u  1  ?.  e  c  r  '.1 :  t  e  r 

Demoaraph ic  Character 

?  r«»  — 

.  o  1  C  ^ 

*  1  C  a  c:  > 

i-a 1  na 

Aoe 
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Fa  ini 

tinj  g: 

k  i  1 1 3 

1 

O 

.  1  o 

AFCT 

te  n 1 nc 

Gkill3 

7  1 

-  I 

,  7  ^ 

2  5.06 

± 

Personal i tv  Characterist 

r-  lycr  tce 

6  _  .  -1  6 

belt-*  rtia'je 

1  ^  .  3  •  ’ 

I  ear 3  of  ovc. 

I ntegr i ty 

3  *4  .  7  ^ 

■;  Act.) 

21,24 

Extroverted 

27 .39 

Years  of  Svc. 

( P.es  .  ) 

16  .  29 

Sense  of  Humor 

S  .  30 

People -Or iented 

11.63 

Behavior  Characteristics 

Specific  Exp'-rience 

30.33 

1 .  ,•  5 

3e 1 f -Star  ter 

35.32 

Sales  Experience 

31.25 

Com.Tii  tment 

14 . 26 

Public  Speaking  Exp. 

31.25 

Flexibility 

15.68 

Counselling  Exp. 

37.50 

ffmrm 


P r  c  f 1  I e  0  £  the  Success  £ul  R e c r  u i t e 

Xpert  ill2. 

?:a.T!ur!  i  1  L  on  Skills  DemO'  '  '  ^ 


DemoqruDhic  Character  ist  ic 


Pud  ic 

Spea.'.  inq 

Age  1  5 

.  G9 

c  •  -  •  ’  1  - 

^  i.  X  i.  ^ 

2  3.50 

Family  Support  36 

.  13 

Wr i t i nq 

Skills  11.29 

AFQT  16 

.  00 

Listeninq  Skills  12.35 

College  Experience  33 

Inform! 

no  7 . 9  : 

eersuadinq  44. 9o 

Mi  1 i tar 

y  Background 

Personality  Characteris 

t  i  c 

P  Hvjra'Je 

Years  of  Svc. 
(Act. ) 

Years  of  Svc. 
( Res  .  ) 


11.40 


S  1  .  0  5 


7.55 


Behav  i  or  Ch.aracter  i  st  i  cs 
11.3  2 


Se 1 f -Star  ter 

Commi  t merit 

Flexibility 

Attention  to 
Detail 

Decisiveness 


54.12 
12.35 
?  .  12 

20.95 

3.53 


Self-Image 
Integr i ty 
Extroverted 
Sense  of  Humor 
People-Oriented 


81.21 
8.84 
1.00 
7 .07 


Specific  Expe r i ence 
17.45 

Sales  Experience  71.47 
Public  Speaking  Exp.  19.24 
Counselling  Exp.  9 . 29 


' . .V :ni;;un  i  c "j  ■  :  >' "i  b i  ii : 
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L  1 J  ten  i  na  .? k  i  1 


-  n  r  o  r  m  1 


Persuaa i nq 


4  -1  .  r  ^ 


‘  ”  1  ^  I  ^  -i 


.  :i .’.  o  r  0 ro 


P  -i  ''OTude 


Ye.ire  of  Svc 
( Act . ) 


40  .43 


Years  of  Svc 
(Res  .  ) 


15.92 


Eehavior  Cha rac ter  1 st  Lcs 
24.53 


Self-Starter 


12.45 


Commitment 


50.33 


Flexibility 


13.51 


Attention  to 
Detail 


10 .52 


Dec  is i veness 


13.0 


e  !no  g  r  a  p  n  j.  c  e  n  :!  r  ■- 
0  .  3  3 


Fa;ni  i.  ■/  3  a ::  f  o  r  . 


Co  *  1  c'je  Z.<yij  c  . '  Hi. 


Sc  I f - I ma qe 


Inteqr i ty 


Extroverted 


Sense  of  Humor 


People-Oriented 


Soecific  Experience 


7  .  4  o 


Sales  Experience 


Public  Speaking  Exp 


Counselling  Exp. 


n  1  i  t  V 


(.^ct.  ) 

j  7  .  2  5 

Extroverted 

a r s  of 

Svc  . 

(.Res  .  ) 

6  .  49 

Sense  of  Humor 

People -Oriented 

h  3  V  i  0  r 

Character istlcs 

Soecific  Exoerience 

3rif-otarter 

Commitment 

Flexibility 

Attention  to 
Detail 

Dec  is i veness 


2  5.10 

3  3.13 
9  .  •’? 

21.09 
1 0  .  ■:  4 


.  8  0 


Sales  Experience  24 . 

Public  Speaking  Exp.  52.02 
Counselling  Exp.  23.22 
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Years  o  t 
(Res.  ) 

Svc  . 

3  3.10 

Extroverted 

Sense  of  Humor 

61.78 

3.93 

People-Oriented 

6.60 

3e  ha  v  i  o  r 

Character 

i  S  t  1  C  3 

.Soecific  Experience 

.ie  1  £  -  3  tar  ter 

4  5.80 

Sales  Experience 

5  3.96 

C  0  .Tjn  i  t  me  n  t 

13.03 

Public  Speaking  Exp. 

34.59 

Flexibility 

12,17 

Counselling  Exp. 

11.46 

Attention  to 

Lit  ta  i  1 

5.39 

3’ec  is  i  veness 

18.11 

APPENDIX  B 


The  Expert  Sy steins;  Indices, 
Variance,  and  Mean  Squared  Error 

Expert  #1. 


Fidelity 

Standards 

Discr im. 

Var iance 

I  ndex 

I  ndex 

Index 

Expla  i  ne' 

Overall 

Profile 

90. 3 

65.5 

18.1 

81.54 

Conun. 

Skills 

83.2 

66 . 5 

41.8 

77.86 

Demog. 

Charac . 

Military 
Backg . 

Person. 

97.8 

89 . 6 

72.7 

72.7 

23.7 

22 . 5 

95.82 

30.37 

Charac . 

87 . 1 

74.0 

25.2 

75.96 

Behavior 

Charac. 

81.7 

73.0 

20.9 

66.79 

Specific 

Exp. 


77.8 


70 . 3 


13.9 


60.65 


Indices, 

The  Expert 
Variance,  and 

Systems i 
Mean-Squar 

ed  Error 

Expert  #2 

• 

Fidelity 

I  ndex 

Standards 

I  ndex 

Discr im. 
Index 

Variance 

Explained 

Mean- 
Sa .  Er: 

Overall 

Profile 

86.1 

80.0 

78.6 

74.18 

9.98 

Comm. 

Skills 

88.2 

56.0 

96.0 

77.89 

11.67 

Deraog . 
Charac. 

97.5 

50.0 

79 . 4 

95.16 

4.37 

Military 

Backg. 

97.7 

34  .  4 

111.9 

95.59 

5.87 

Person. 
Charac . 

92.0 

78.3 

99.8 

84 . 71 

9.75 

Behavior 

Charac. 

92.0 

67.5 

102.7 

84.65 

10 . 06 

Specific 

Exp. 

96.1 

33.8 

70.4 

92.39 

4.85 

?»!S5Si 
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Expert  ^3. 


The  Expert  Systems: 

Indices,  Variance,  and  Mean-Squared  Error 


Fidelity 

I  ndex 

Standards 

I  ndex 

Discrim. 

1  ndex 

Variance 

Exolained 

Mean- 
Sa .Err 

Overall 

Profile 

89 . 4 

99.3 

55.9 

80 . 03 

6 .25 

Conun. 

Skills 

94.5 

43.5 

82.0 

89.43 

6.66 

Demog . 
Charac . 

95.0 

49.2 

92.1 

90.40 

7.13 

Military 

Backg. 

91.1 

59.4 

31.2 

83.08 

3.21 

Person. 

Charac. 

95.4 

67.0 

85.2 

91.18 

6.33 

Behavior 

Charac. 

93.9 

65.0 

53.7 

88.18 

4.61 

Specific 

Exp. 

89 . 4 

56.3 

17.3 

80.00 

1.94 
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The  Expert  Systems: 

Indices,  Variance,  and  Mean-Squared  Error 


Expert  #4 


Fidelity 

Index 

Standards 

I  ndex 

Discrim. 

Index 

Variance 

Explained 

Mean- 
Sa .  Er 

Overall 

Profile 

92.8 

59.2 

79 . 2 

86.19 

7 . 36 

Conun. 

Skills 

90.1 

49.0 

88.0 

81.35 

9 . 50 

Demog. 

Charac. 

75.4 

48.6 

70.3 

56 . 86 

11.54 

Military 

Backg. 

87.0 

28.1 

69.1 

75.81 

8 . 50 

Person. 

Charac. 

85.7 

80 . 0 

86.9 

73.60 

11.16 

Behavior 

Charac. 

89 . 5 

59.0 

50.4 

80.20 

5.61 

Specific 

Exp. 

96.6 

37.8 

61.8 

93.48 

3.95 

Expert  #5 


The  Expert  Systems: 

Indices,  Variance,  and  Mean-Squared  Error 


Fidelity 

I  ndex 

Standards 

Index 

Discrim. 

I  ndex 

Var iance 
Exola  ined 

Mean- 
Sa . Er r 

Overall 

Profile 

94.5 

80.0 

47.7 

89 . 39 

3 .88 

Conun. 

Skills 

33.4 

66.0 

73.2 

87.26 

6.53 

Oemog . 
Charac. 

93.6 

50.0 

70 . 7 

87 . 70 

6 . 20 

Military 

Backg. 

96.7 

50.0 

66.3 

93.64 

4 .18 

Person. 
Charac . 

94.3 

79 .0 

75.4 

88.97 

6 .26 

Behavior 

Charac. 

96.9 

64.0 

60.5 

93.95 

3.72 

Specific 

Exp. 

96.5 

52.3 

56.2 

93.19 

3.67 
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The  Expert  Systems: 

Indices,  Variance,  and  Mean-Squared  Error 


Expert  #6. 


Fidelity 

Index 

Standards 

I  ndex 

Discrim. 

Index 

Var iance 
Explained 

Overall 

Profile 

97.9 

58.0 

62.2 

96.02 

Comm. 

Skills 

96.0 

42.4 

76.5 

92.17 

Demog. 

Charac. 

96.4 

51.6 

64 . 4 

93.00 

Military 
Backg . 

89 . 2 

40.6 

61.4 

79 . 74 

Person . 
Charac . 

95.6 

57.0 

58.5 

91.50 

Behavior 
Charac . 

96.9 

60.5 

55.6 

93.91 

Specific 

Exp. 

93.5 

29.7 

62.4 

87.51 
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Expert  #7 


The  Expert  Systems: 

Indices,  Variance,  and  Mean-Squared  Error 


Fidelity 

Index 

Standards 
I  ndex 

Overall 

Profile 

95.9 

51 . 4 

Comm. 

Skills 

87 . 5 

42.6 

Demoq . 
Charac . 

93.6 

45.0 

Military 
Backg . 

86.6 

35.6 

Person. 

Charac. 

90.8 

56.9 

Behavior 

Charac. 

92.8 

55.0 

Specific 

Exp. 

93 . 4 

48.9 

Discr im. 

I  ndex 

Var iance 
Exola i ned 

Mean- 
Sa . Er r 

43.7 

92 . 08 

3.08 

68 . 8 

76.73 

8.29 

59 . 5 

87.77 

5.20 

55.9 

75.04 

6.99 

57.6 

82.48 

6.03 

39 . 7 

86.24 

3.68 

23.7 

87.39 

2.10 

The  Expert  Systems: 

Indices,  Variance,  and  Mean-Squared  Error 

Expert  #8. 


Fidelity 

I  ndex 

Standards 

I  ndex 

Discrim, 

Index 

Var  iance 
Exola i ned 

Overall 

Profile 

91.2 

77.0 

83.8 

83.27 

Comm. 

Skills 

87 . 7 

45.0 

74.2 

76.93 

Demoq . 
Charac. 

93.6 

42.2 

57.8 

87.63 

Military 
Backg . 

91.5 

35.9 

52.9 

83 . 85 

Person. 
Charac . 

78 . 3 

67.0 

81.4 

61 .33 

Behavior 

Charac. 

82.4 

81.6 

92.4 

67.90 

Specific 

Exp. 

92.2 

67.2 

56.1 

85.01 
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The  Expert  Systems: 

Indices,  Variance,  and  Mean-Squared  Error 


Expert  #9. 


Fidelity 

Index 

Standards 

I  ndex 

Discr im. 
Index 

Variance 

Explained 

Overa 1 1 
Profile 

83.3 

62.0 

69.9 

69.43 

Co  nun. 
Skills 

88 . 0 

58.0 

86.0 

77.52 

Demog . 
Charac. 

78.1 

53.1 

102.8 

61.04 

Military 
Backg . 

90 . 4 

35.9 

94.8 

81.86 

Person. 

Charac. 

75.4 

63.0 

92.7 

56.90 

Behavior 

Charac. 

83.3 

71.1 

93.4 

69 . 47 

Specific 

Exp. 

92.7 

29.8 

84.9 

86.07 

The  Expert  Systems: 

Indices,  Variance,  and  Mean-Squared  Error 


Expert  #10. 


Fidelity 

Index 

Standards 

I  ndex 

Discrim. 

I  ndex 

Variance 

Explained 

Mean- 
Sa . Er r 

Overall 

Profile 

95.4 

61.0 

89.1 

91.13 

6 . 63 

Conun  • 
Skills 

94.6 

64.0 

79.9 

89.49 

6.47 

Demog . 
Charac. 

96 . 5 

54.7 

66.7 

93.16 

4 . 36 

Military 

Backg. 

91.0 

52.3 

68.6 

82.96 

7.08 

Person . 
Charac . 

94.1 

79.1 

100.8 

88.61 

8.50 

Behavior 

Charac. 

96.0 

66.5 

84 . 4 

92.22 

5.89 

Specific 

Exp. 

96.5 

48.4 

71.0 

93.28 

4.60 

Indices, 

The  Expert 
Variance,  and 

Systems : 

Mean-Squared  Error 

Expert  #11 

• 

Fidelity 
I  ndex 

Standards 

Index 

Discrim. 

I  ndex 

Var iance 
Expla i ned 

Overall 

Profile 

86 . 7 

70 . 0 

76.0 

75.34 

Comm. 

Skills 

81.7 

38-. 3 

124.2 

66 . 88 

Oemog . 
Charac. 

95.8 

32.8 

74.5 

91.82 

Military 

Backg. 

96 . 3 

48.4 

78.1 

92.76 

Person. 

Charac. 

85.0 

87.1 

95.0 

72 . 40 

Behavior 

Charac. 

95.1 

63.0 

79 . 3 

90.57 

Specific 

Exp. 

97.0 

31.3 

85.4 

94 . 25 

Mean- 
Sq . Err 


9 .44 

17.87 

5.33 

5.25 

12.47 

6.09 

5.12 


The  Expert  Systems: 

Indices,  Variance,  and  Mean-Squared  Error 


Expert  #12. 


Fidelity 

Index 

Standards 

I  ndex 

Discrim. 

I  ndex 

Variance 
Exola i ned 

Mean- 
Sa .  Er 

Overall 

Profile 

95.0 

17.8 

103.8 

90.38 

8.05 

Comm. 

Skills 

96.6 

6.9 

90.3 

93.37 

5.81 

Demog. 

Charac. 

92.7 

5.5 

58.9 

86 . 00 

5.51 

Mi litary 
Backg . 

98.6 

28.0 

70.5 

97.32 

2.89 

Person. 
Charac . 

98.0 

30.9 

121.9 

96 . 13 

6.00 

Behavior 
Charac . 

96.0 

20.1 

101.4 

92.34 

7.02 

Specific 

Exp. 

94.3 

11.9 

74.3 

88.99 

6.16 

The  Expert  Systems: 

Indices,  Variance,  and  Mean-Squared  Error 


Expert  #13. 

Fidelity 
I  ndex 


Overall 

Pr of i le 

96.0 

Conan. 

Skills 

96.7 

Demog . 
Charac . 

98.2 

Military 
Backg . 

89 . 4 

Perso.n  - 
Charac . 

97.3 

Behavior 

Charac. 

95.9 

Specific 

Exp. 

95.2 

Standards  Discrim. 


I  ndex 

Index 

55.5 

62.2 

64 . 0 

62.1 

62 . 5 

46.9 

57.8 

4  6.3 

73.5 

66.0 

68 . 0 

62.0 

49 . 2 

53.1 

Var iance 
Exola i ned 

Mean- 
Sa . Err 

92.16 

4 . 36 

93.59 

3.93 

96.48 

2.20 

80.00 

5.18 

94.83 

3.75 

92 . 11 

4.41 

90 . 78 

4.03 

The  Expert  Systems: 

Indices,  Variance,  and  Mean-Squared  Error 


Expert  #14. 


Fidelity 

I  ndex 

Standards 
I  ndex 

Overall 

Profile 

88 . 7 

84.7 

Conun. 

Skills 

85.9 

92 . 7 

Demog. 
Charac . 

96 . 0 

82.0 

Military 
Backg . 

69.1 

41.6 

Person . 
Charac . 

85 . 6 

100 . 3 

Behavior 

Charac. 

79 . 6 

109.7 

Specific 

Exp. 

86.2 

31.3 

Discr im. 

I  ndex 

Variance 
Expla  ined 

Mean- 
So .  Er 

82.3 

78.82 

9 . 50 

64.5 

12. 35 

8.39 

114 . 8 

92.29 

8 . 02 

49.5 

47.83 

8.94 

85.0 

73.41 

11.16 

67.2 

63 .45 

10.20 

62.4 

74 . 36 

7.91 
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The  Expert  Systems; 

Indices,  Variance,  and  Mean-Squared  Error 
Expert  #15. 

Fidelity  Standards  Discrim.  Variance 


I  ndex 

I  ndex 

Index 

Exola ined 

Overall 

Profile 

94.1 

62.0 

88.1 

88.62 

Conan. 

Skills 

90.7 

60.6 

80.7 

82.32 

Demog. 

Charac. 

93 . 4 

76.6 

59 . 5 

87.30 

Military 

Backg. 

97.5 

69.5 

83.7 

95.14 

Person. 
Charac . 

93.0 

69.3 

78.7 

86.66 

Behavior 

Charac. 

92.9 

58.5 

61.1 

86.44 

Specific 

Exp. 


93.4 


68.8 


67.8 


87.28 


The  Expert  Systems: 

Indices,  Variance,  and  Mean-Squared  Error 


Expert  #16. 


Fidelity 

Index 

Standards 

I  ndex 

Discrim. 

I  ndex 

Var iance 
Exola i ned 

Mean 
Sa .  E 

Overall 

Profile 

92.6 

60.7 

92.4 

85.83 

8 . 6 

Conun. 

Skills 

90.2 

71 . 8 

76 . 3 

81 .38 

8 . 2 

Demog . 
Charac. 

97.1 

59 . 7 

100.2 

9  4.31 

6 . 0 

Military 
Backg . 

92.4 

78.1 

64 . 3 

85.44 

6.1 

Person . 
Charac. 

93.5 

47 . 4 

98.8 

87 . 59 

8 . 7i 

Behavior 

Charac. 

92.3 

57.4 

84.3 

{;5. 33 

7.8* 

Specific 

Exp. 

95.1 

39.8 

74.1 

90.47 

5.7: 

Indices , 

The  Expert 
Variance,  and 

Systems : 

Mean-Squared  Error 

Expert 

MAGR 

Fide  1 i ty 

I  ndex 

Standards 

1  ndex 

Discrim. 

Index 

Var iance 
Explained 

Overall 

Profile 

97.3 

73.5 

40.9 

CO 

Conun. 

Skills 

98 . 2 

53 . 5 

64.8 

96  55 

Demog . 

Charac . 

96 . 6 

53 . 4 

58.3 

93.47 

Military 

Backg. 

96 . 7 

46 . 4 

45.7 

93 . 61 

Person. 
Charac . 

Behavior 

Charac. 

Specific 

Exp. 


96.2 

74.0 

60.9 

92.62 

97.5 

46.3 

48.4 

95.21 

96.7 

46.3 

38.3 

93.70 

The  Expert  Systems: 

Indices,  Variance,  and  Mean-Squared  Error 
Expert  MPA 


Fidelity 

I  ndex 

Standards 

I  ndex 

Discrim. 

I  ndex 

Variance 
Expla i ned 

Overall 

Profile 

97.0 

59.9 

62.1 

94.17 

Comm. 

Skills 

96.5 

54.8 

68 . 1 

93.21 

Demog . 
Charac . 

98.0 

51.4 

60.6 

96.07 

Military 

Backg. 

96.9 

48 . 3 

53.0 

94.01 

Person. 
Charac . 

97.1 

67.5 

66.8 

94.35 

Behavior 
Charac . 

96.4 

65.2 

53.4 

92.97 

Specific 


Applicant 


Attribute 


Public  speaking 


Writing 


Listening 


Informing 


Persuading 


Family  support 


College  exp. 


Paygrade 


YOS  (A) 


YOS  (R) 


Self-image 


Integrity 


Extroverted 


Sense  of  humor 


People-oriented 


Self-starter 


Commitment 


Flexibility 


Attention  to 
Detail 


Appendix  C,  continued 


Applicant 

Attribute 

Decisiveness 

Sales  exp. 

Public  speak¬ 
ing  exp. 

Counselling  exp. 


Applicant 


Attribute 


Public  speaking 

Writing 

Listening 

Informing 

Persuading 


Family  support 


College  exp. 
Paygrade 
YDS  (A) 


YOS  (R) 


Self-image 

Integrity 


M  N 


fsmmm 


Applicant  K  L  M 

Attribute 

Extroverted  278 

Sense  of  humor  2  7  1 

People-oriented  278 
Self-starter  278 

Commitment  278 

Flexibility  2  7  1 

Attention  to 

Detail  2  7  1 

Decisiveness  2  7  1 

Sales  exp,  278 

Public  speaking 

exp.  2  7  1 

Counselling  exp.  2  7  1 


N  0  P  S  T  U  V 

14  9^462 
8  6  4  2  8  3  9 
1  4  5  6  3  7  2 
1  6  6  8  7  2  9 
1  4  3  9  2  6  2 
8  6  2  5  3  4  9 

8  4  5  6  9  2  2 
8  6  8  3  7  3  9 
1  4  9  1  8  2  2 

8  6  9  3  7  1  9 
8  4  1  9  2  2  2 
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